Result | FAILURE |
Tests | 116 failed / 345 succeeded |
Started | |
Elapsed | 3h8m |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-auth\]\sServiceAccounts\sServiceAccountIssuerDiscovery\sshould\ssupport\sOIDC\sdiscovery\sof\sservice\saccount\sissuer\s\[Conformance\]$'
[FAILED] Unexpected error getting pod logs: timed out waiting for the condition In [It] at: test/e2e/auth/service_accounts.go:630 @ 03/24/23 07:51:31.011from junit_01.xml
> Enter [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/24/23 07:49:28.939 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 07:49:28.939 Mar 24 07:49:28.939: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename svcaccounts - test/e2e/framework/framework.go:250 @ 03/24/23 07:49:28.941 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 07:49:28.964 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 07:49:28.968 < Exit [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/24/23 07:49:28.972 (33ms) > Enter [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 07:49:28.972 < Exit [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 07:49:28.972 (0s) > Enter [It] ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance] - test/e2e/auth/service_accounts.go:529 @ 03/24/23 07:49:28.972 Mar 24 07:49:28.988: INFO: created pod STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 07:49:30.998 Mar 24 07:50:00.998: INFO: polling logs Mar 24 07:50:01.000: INFO: Error pulling logs: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-8939/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 167; INTERNAL_ERROR; received from peer Mar 24 07:50:31.001: INFO: polling logs Mar 24 07:50:31.003: INFO: Error pulling logs: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-8939/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 169; INTERNAL_ERROR; received from peer Mar 24 07:51:00.998: INFO: polling logs Mar 24 07:51:01.001: INFO: Error pulling logs: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-8939/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 171; INTERNAL_ERROR; received from peer Mar 24 07:51:31.001: INFO: polling logs Mar 24 07:51:31.004: INFO: Error pulling logs: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-8939/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 173; INTERNAL_ERROR; received from peer Mar 24 07:51:31.004: INFO: polling logs Mar 24 07:51:31.006: INFO: Error pulling logs: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-8939/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false": stream error: stream ID 175; INTERNAL_ERROR; received from peer [FAILED] Unexpected error getting pod logs: timed out waiting for the condition In [It] at: test/e2e/auth/service_accounts.go:630 @ 03/24/23 07:51:31.011 < Exit [It] ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance] - test/e2e/auth/service_accounts.go:529 @ 03/24/23 07:51:31.011 (2m2.038s) > Enter [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/24/23 07:51:31.011 Mar 24 07:51:31.011: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/24/23 07:51:31.014 (3ms) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 07:51:31.014 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 07:51:31.014 (0s) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/24/23 07:51:31.014 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 07:51:31.014 STEP: Collecting events from namespace "svcaccounts-8939". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 07:51:31.014 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 07:51:31.016 Mar 24 07:51:31.016: INFO: At 2023-03-24 07:49:28 +0000 UTC - event for oidc-discovery-validator: {default-scheduler } Scheduled: Successfully assigned svcaccounts-8939/oidc-discovery-validator to kind-worker Mar 24 07:51:31.016: INFO: At 2023-03-24 07:49:29 +0000 UTC - event for oidc-discovery-validator: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 07:51:31.016: INFO: At 2023-03-24 07:49:29 +0000 UTC - event for oidc-discovery-validator: {kubelet kind-worker} Created: Created container oidc-discovery-validator Mar 24 07:51:31.016: INFO: At 2023-03-24 07:49:29 +0000 UTC - event for oidc-discovery-validator: {kubelet kind-worker} Started: Started container oidc-discovery-validator Mar 24 07:51:31.019: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 07:51:31.019: INFO: oidc-discovery-validator kind-worker Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:49:28 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:49:28 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:49:28 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:49:28 +0000 UTC }] Mar 24 07:51:31.019: INFO: Mar 24 07:51:31.021: INFO: Unable to fetch svcaccounts-8939/oidc-discovery-validator/oidc-discovery-validator logs: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-8939/pods/oidc-discovery-validator/log?container=oidc-discovery-validator&previous=false&tailLines=42": stream error: stream ID 185; INTERNAL_ERROR; received from peer Mar 24 07:51:31.024: INFO: Logging node info for node kind-control-plane Mar 24 07:51:31.026: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 4165 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 07:48:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:48:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 07:51:31.027: INFO: Logging kubelet events for node kind-control-plane Mar 24 07:51:31.030: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 07:51:31.045: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 07:51:31.045: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container etcd ready: true, restart count 0 Mar 24 07:51:31.045: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 07:51:31.045: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 07:51:31.045: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container coredns ready: true, restart count 0 Mar 24 07:51:31.045: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 07:51:31.045: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 07:51:31.045: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 07:51:31.045: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.045: INFO: Container coredns ready: true, restart count 0 Mar 24 07:51:31.084: INFO: Latency metrics for node kind-control-plane Mar 24 07:51:31.085: INFO: Logging node info for node kind-worker Mar 24 07:51:31.088: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 3927 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 07:48:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 07:51:31.088: INFO: Logging kubelet events for node kind-worker Mar 24 07:51:31.092: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 07:51:31.106: INFO: oidc-discovery-validator started at 2023-03-24 07:49:28 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.106: INFO: Container oidc-discovery-validator ready: false, restart count 0 Mar 24 07:51:31.106: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.106: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 07:51:31.106: INFO: pod-service-account-mountsa-mountspec started at 2023-03-24 07:49:28 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.106: INFO: Container token-test ready: false, restart count 0 Mar 24 07:51:31.106: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.106: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 07:51:31.145: INFO: Latency metrics for node kind-worker Mar 24 07:51:31.145: INFO: Logging node info for node kind-worker2 Mar 24 07:51:31.148: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 3934 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 07:48:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:48:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 07:51:31.149: INFO: Logging kubelet events for node kind-worker2 Mar 24 07:51:31.152: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 07:51:31.167: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.167: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 07:51:31.167: INFO: pod-service-account-defaultsa started at 2023-03-24 07:49:28 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.167: INFO: Container token-test ready: false, restart count 0 Mar 24 07:51:31.167: INFO: pod-service-account-mountsa started at 2023-03-24 07:49:28 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.167: INFO: Container token-test ready: false, restart count 0 Mar 24 07:51:31.167: INFO: pod-service-account-defaultsa-mountspec started at 2023-03-24 07:49:28 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.167: INFO: Container token-test ready: false, restart count 0 Mar 24 07:51:31.167: INFO: pod-service-account-nomountsa-mountspec started at 2023-03-24 07:49:28 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.167: INFO: Container token-test ready: false, restart count 0 Mar 24 07:51:31.167: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 07:51:31.167: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 07:51:31.199: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 07:51:31.2 (186ms) < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/24/23 07:51:31.2 (186ms) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/24/23 07:51:31.2 STEP: Destroying namespace "svcaccounts-8939" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 07:51:31.2 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/24/23 07:51:31.205 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 07:51:31.205 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 07:51:31.205 (0s)
Find logs mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-auth\]\sServiceAccounts\sshould\smount\sprojected\sservice\saccount\stoken\s\[Conformance\]$'
[FAILED] failed to get logs from test-pod-624985d6-4e21-41e9-8d05-bd08653515e3 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-1911/pods/test-pod-624985d6-4e21-41e9-8d05-bd08653515e3/log?container=agnhost-container&previous=false": stream error: stream ID 6963; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:20:51.052from junit_01.xml
> Enter [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/24/23 09:20:47.006 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 09:20:47.006 Mar 24 09:20:47.006: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename svcaccounts - test/e2e/framework/framework.go:250 @ 03/24/23 09:20:47.007 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 09:20:47.016 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 09:20:47.019 < Exit [BeforeEach] [sig-auth] ServiceAccounts - set up framework | framework.go:191 @ 03/24/23 09:20:47.022 (16ms) > Enter [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:20:47.022 < Exit [BeforeEach] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:20:47.022 (0s) > Enter [It] should mount projected service account token [Conformance] - test/e2e/auth/service_accounts.go:275 @ 03/24/23 09:20:47.022 STEP: Creating a pod to test service account token: - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 09:20:47.022 E0324 09:20:47.671779 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:20:48.671843 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:20:49.672703 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:20:50.672854 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 09:20:51.038 Mar 24 09:20:51.042: INFO: Trying to get logs from node kind-worker2 pod test-pod-624985d6-4e21-41e9-8d05-bd08653515e3 container agnhost-container: <nil> Mar 24 09:20:51.044: INFO: Failed to get logs from node "kind-worker2" pod "test-pod-624985d6-4e21-41e9-8d05-bd08653515e3" container "agnhost-container". Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-1911/pods/test-pod-624985d6-4e21-41e9-8d05-bd08653515e3/log?container=agnhost-container&previous=false": stream error: stream ID 6963; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 09:20:51.044 Mar 24 09:20:51.052: INFO: Unexpected error: <*fmt.wrapError | 0xc0039247a0>: failed to get logs from test-pod-624985d6-4e21-41e9-8d05-bd08653515e3 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-1911/pods/test-pod-624985d6-4e21-41e9-8d05-bd08653515e3/log?container=agnhost-container&previous=false": stream error: stream ID 6963; INTERNAL_ERROR; received from peer { msg: "failed to get logs from test-pod-624985d6-4e21-41e9-8d05-bd08653515e3 for agnhost-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-1911/pods/test-pod-624985d6-4e21-41e9-8d05-bd08653515e3/log?container=agnhost-container&previous=false\": stream error: stream ID 6963; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc004587c20>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-1911/pods/test-pod-624985d6-4e21-41e9-8d05-bd08653515e3/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 6963, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from test-pod-624985d6-4e21-41e9-8d05-bd08653515e3 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/svcaccounts-1911/pods/test-pod-624985d6-4e21-41e9-8d05-bd08653515e3/log?container=agnhost-container&previous=false": stream error: stream ID 6963; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:20:51.052 < Exit [It] should mount projected service account token [Conformance] - test/e2e/auth/service_accounts.go:275 @ 03/24/23 09:20:51.052 (4.03s) > Enter [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:20:51.052 Mar 24 09:20:51.052: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-auth] ServiceAccounts - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:20:51.055 (3ms) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:20:51.055 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:20:51.055 (0s) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/24/23 09:20:51.055 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:20:51.055 STEP: Collecting events from namespace "svcaccounts-1911". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 09:20:51.055 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 09:20:51.057 Mar 24 09:20:51.057: INFO: At 2023-03-24 09:20:47 +0000 UTC - event for test-pod-624985d6-4e21-41e9-8d05-bd08653515e3: {default-scheduler } Scheduled: Successfully assigned svcaccounts-1911/test-pod-624985d6-4e21-41e9-8d05-bd08653515e3 to kind-worker2 Mar 24 09:20:51.057: INFO: At 2023-03-24 09:20:47 +0000 UTC - event for test-pod-624985d6-4e21-41e9-8d05-bd08653515e3: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 09:20:51.057: INFO: At 2023-03-24 09:20:47 +0000 UTC - event for test-pod-624985d6-4e21-41e9-8d05-bd08653515e3: {kubelet kind-worker2} Created: Created container agnhost-container Mar 24 09:20:51.057: INFO: At 2023-03-24 09:20:47 +0000 UTC - event for test-pod-624985d6-4e21-41e9-8d05-bd08653515e3: {kubelet kind-worker2} Started: Started container agnhost-container Mar 24 09:20:51.059: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 09:20:51.059: INFO: Mar 24 09:20:51.062: INFO: Logging node info for node kind-control-plane Mar 24 09:20:51.064: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 25299 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 09:20:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:20:51.065: INFO: Logging kubelet events for node kind-control-plane Mar 24 09:20:51.067: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 09:20:51.073: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.073: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 09:20:51.073: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.073: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:20:51.073: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.073: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 09:20:51.073: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.073: INFO: Container etcd ready: true, restart count 0 Mar 24 09:20:51.073: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.073: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 09:20:51.073: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.073: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 09:20:51.073: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.073: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:20:51.113: INFO: Latency metrics for node kind-control-plane Mar 24 09:20:51.113: INFO: Logging node info for node kind-worker Mar 24 09:20:51.119: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 25341 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 09:16:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:16:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:16:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:16:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:16:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:20:51.119: INFO: Logging kubelet events for node kind-worker Mar 24 09:20:51.123: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 09:20:51.128: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.128: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:20:51.128: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.128: INFO: Container coredns ready: true, restart count 0 Mar 24 09:20:51.128: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.128: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:20:51.166: INFO: Latency metrics for node kind-worker Mar 24 09:20:51.166: INFO: Logging node info for node kind-worker2 Mar 24 09:20:51.169: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 25207 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 09:19:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:20:51.169: INFO: Logging kubelet events for node kind-worker2 Mar 24 09:20:51.172: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 09:20:51.177: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.177: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:20:51.177: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.177: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:20:51.177: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:20:51.177: INFO: Container coredns ready: true, restart count 0 Mar 24 09:20:51.210: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:20:51.21 (155ms) < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - dump namespaces | framework.go:209 @ 03/24/23 09:20:51.21 (155ms) > Enter [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/24/23 09:20:51.21 STEP: Destroying namespace "svcaccounts-1911" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 09:20:51.21 < Exit [DeferCleanup (Each)] [sig-auth] ServiceAccounts - tear down framework | framework.go:206 @ 03/24/23 09:20:51.215 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:20:51.215 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:20:51.215 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sKubectl\sexpose\sshould\screate\sservices\sfor\src\s\s\[Conformance\]$'
[FAILED] error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-7853 logs agnhost-primary-mp7vn agnhost-primary: Command stdout: stderr: Unable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/24/23 10:33:54.816from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/24/23 10:33:52.036 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:33:52.036 Mar 24 10:33:52.036: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename kubectl - test/e2e/framework/framework.go:250 @ 03/24/23 10:33:52.037 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:33:52.047 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:33:52.051 < Exit [BeforeEach] [sig-cli] Kubectl client - set up framework | framework.go:191 @ 03/24/23 10:33:52.054 (18ms) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:33:52.054 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:33:52.054 (0s) > Enter [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/24/23 10:33:52.054 < Exit [BeforeEach] [sig-cli] Kubectl client - test/e2e/kubectl/kubectl.go:276 @ 03/24/23 10:33:52.054 (0s) > Enter [It] should create services for rc [Conformance] - test/e2e/kubectl/kubectl.go:1480 @ 03/24/23 10:33:52.054 STEP: creating Agnhost RC - test/e2e/kubectl/kubectl.go:1485 @ 03/24/23 10:33:52.054 Mar 24 10:33:52.054: INFO: namespace kubectl-7853 Mar 24 10:33:52.054: INFO: Running '/home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-7853 create -f -' E0324 10:33:52.718209 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 10:33:52.741: INFO: stderr: "" Mar 24 10:33:52.742: INFO: stdout: "replicationcontroller/agnhost-primary created\n" STEP: Waiting for Agnhost primary to start. - test/e2e/kubectl/kubectl.go:1491 @ 03/24/23 10:33:52.742 E0324 10:33:53.718275 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 10:33:53.745: INFO: Selector matched 1 pods for map[app:agnhost] Mar 24 10:33:53.745: INFO: Found 0 / 1 E0324 10:33:54.718920 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 10:33:54.746: INFO: Selector matched 1 pods for map[app:agnhost] Mar 24 10:33:54.746: INFO: Found 1 / 1 Mar 24 10:33:54.746: INFO: WaitFor completed with timeout 5m0s. Pods found = 1 out of 1 Mar 24 10:33:54.748: INFO: Selector matched 1 pods for map[app:agnhost] Mar 24 10:33:54.748: INFO: ForEach: Found 1 pods from the filter. Now looping through them. Mar 24 10:33:54.748: INFO: wait on agnhost-primary startup in kubectl-7853 Mar 24 10:33:54.748: INFO: Running '/home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-7853 logs agnhost-primary-mp7vn agnhost-primary' Mar 24 10:33:54.816: INFO: rc: 1 Mar 24 10:33:54.816: INFO: Unexpected error: <exec.CodeExitError>: error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-7853 logs agnhost-primary-mp7vn agnhost-primary: Command stdout: stderr: Unable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer error: exit status 1 { Err: <*errors.errorString | 0xc00142ffe0>{ s: "error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-7853 logs agnhost-primary-mp7vn agnhost-primary:\nCommand stdout:\n\nstderr:\nUnable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer\n\nerror:\nexit status 1", }, Code: 1, } [FAILED] error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-7853 logs agnhost-primary-mp7vn agnhost-primary: Command stdout: stderr: Unable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/24/23 10:33:54.816 < Exit [It] should create services for rc [Conformance] - test/e2e/kubectl/kubectl.go:1480 @ 03/24/23 10:33:54.816 (2.762s) > Enter [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:33:54.816 Mar 24 10:33:54.816: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl client - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:33:54.82 (3ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:33:54.82 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:33:54.82 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/24/23 10:33:54.82 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:33:54.82 STEP: Collecting events from namespace "kubectl-7853". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:33:54.82 STEP: Found 5 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:33:54.822 Mar 24 10:33:54.822: INFO: At 2023-03-24 10:33:52 +0000 UTC - event for agnhost-primary: {replication-controller } SuccessfulCreate: Created pod: agnhost-primary-mp7vn Mar 24 10:33:54.822: INFO: At 2023-03-24 10:33:52 +0000 UTC - event for agnhost-primary-mp7vn: {default-scheduler } Scheduled: Successfully assigned kubectl-7853/agnhost-primary-mp7vn to kind-worker Mar 24 10:33:54.822: INFO: At 2023-03-24 10:33:53 +0000 UTC - event for agnhost-primary-mp7vn: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 10:33:54.822: INFO: At 2023-03-24 10:33:53 +0000 UTC - event for agnhost-primary-mp7vn: {kubelet kind-worker} Created: Created container agnhost-primary Mar 24 10:33:54.822: INFO: At 2023-03-24 10:33:53 +0000 UTC - event for agnhost-primary-mp7vn: {kubelet kind-worker} Started: Started container agnhost-primary Mar 24 10:33:54.824: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:33:54.824: INFO: agnhost-primary-mp7vn kind-worker Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:33:52 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:33:54 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:33:54 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:33:52 +0000 UTC }] Mar 24 10:33:54.824: INFO: Mar 24 10:33:54.826: INFO: Unable to fetch kubectl-7853/agnhost-primary-mp7vn/agnhost-primary logs: Get "https://127.0.0.1:39221/api/v1/namespaces/kubectl-7853/pods/agnhost-primary-mp7vn/log?container=agnhost-primary&previous=false&tailLines=42": stream error: stream ID 4401; INTERNAL_ERROR; received from peer Mar 24 10:33:54.829: INFO: Logging node info for node kind-control-plane Mar 24 10:33:54.831: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 45376 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:31:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:33:54.831: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:33:54.835: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:33:54.841: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.841: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:33:54.841: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.841: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:33:54.841: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.841: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:33:54.841: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.841: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:33:54.841: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.841: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:33:54.841: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.841: INFO: Container etcd ready: true, restart count 0 Mar 24 10:33:54.841: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.841: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:33:54.878: INFO: Latency metrics for node kind-control-plane Mar 24 10:33:54.878: INFO: Logging node info for node kind-worker Mar 24 10:33:54.881: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 45050 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:29:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:29:22 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:29:22 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:29:22 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:29:22 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:33:54.882: INFO: Logging kubelet events for node kind-worker Mar 24 10:33:54.886: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 10:33:54.891: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.891: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:33:54.891: INFO: coredns-5d78c9869d-g8gjd started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.891: INFO: Container coredns ready: true, restart count 0 Mar 24 10:33:54.891: INFO: agnhost-primary-mp7vn started at 2023-03-24 10:33:52 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.891: INFO: Container agnhost-primary ready: true, restart count 0 Mar 24 10:33:54.891: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.891: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:33:54.923: INFO: Latency metrics for node kind-worker Mar 24 10:33:54.923: INFO: Logging node info for node kind-worker2 Mar 24 10:33:54.926: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 44883 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:29:01 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:29:01 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:29:01 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:29:01 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:29:01 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:33:54.926: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:33:54.930: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:33:54.935: INFO: execpod-mb8lj started at 2023-03-24 10:33:43 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.935: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 10:33:54.935: INFO: coredns-5d78c9869d-q87g7 started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.935: INFO: Container coredns ready: true, restart count 0 Mar 24 10:33:54.935: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.935: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:33:54.935: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:33:54.935: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:33:54.976: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:33:54.976 (156ms) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - dump namespaces | framework.go:209 @ 03/24/23 10:33:54.976 (156ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/24/23 10:33:54.976 STEP: Destroying namespace "kubectl-7853" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:33:54.976 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl client - tear down framework | framework.go:206 @ 03/24/23 10:33:54.981 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:33:54.981 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:33:54.981 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\slogs\slogs\sshould\sbe\sable\sto\sretrieve\sand\sfilter\slogs\s\s\[Conformance\]$'
[FAILED] error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-logs-9382 logs logs-generator logs-generator: Command stdout: stderr: Unable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/24/23 08:41:01.504from junit_01.xml
> Enter [BeforeEach] [sig-cli] Kubectl logs - set up framework | framework.go:191 @ 03/24/23 08:40:59.341 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:40:59.341 Mar 24 08:40:59.341: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename kubectl-logs - test/e2e/framework/framework.go:250 @ 03/24/23 08:40:59.342 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:40:59.351 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:40:59.354 < Exit [BeforeEach] [sig-cli] Kubectl logs - set up framework | framework.go:191 @ 03/24/23 08:40:59.357 (16ms) > Enter [BeforeEach] [sig-cli] Kubectl logs - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:40:59.357 < Exit [BeforeEach] [sig-cli] Kubectl logs - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:40:59.357 (0s) > Enter [BeforeEach] [sig-cli] Kubectl logs - test/e2e/kubectl/logs.go:79 @ 03/24/23 08:40:59.357 < Exit [BeforeEach] [sig-cli] Kubectl logs - test/e2e/kubectl/logs.go:79 @ 03/24/23 08:40:59.357 (0s) > Enter [BeforeEach] logs - test/e2e/kubectl/logs.go:94 @ 03/24/23 08:40:59.357 STEP: creating an pod - test/e2e/kubectl/logs.go:95 @ 03/24/23 08:40:59.357 Mar 24 08:40:59.357: INFO: Running '/home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-logs-9382 run logs-generator --image=registry.k8s.io/e2e-test-images/agnhost:2.43 --restart=Never --pod-running-timeout=2m0s -- logs-generator --log-lines-total 100 --run-duration 20s' Mar 24 08:40:59.427: INFO: stderr: "" Mar 24 08:40:59.427: INFO: stdout: "pod/logs-generator created\n" < Exit [BeforeEach] logs - test/e2e/kubectl/logs.go:94 @ 03/24/23 08:40:59.427 (70ms) > Enter [It] should be able to retrieve and filter logs [Conformance] - test/e2e/kubectl/logs.go:114 @ 03/24/23 08:40:59.427 STEP: Waiting for log generator to start. - test/e2e/kubectl/logs.go:116 @ 03/24/23 08:40:59.427 Mar 24 08:40:59.427: INFO: Waiting up to 5m0s for 1 pods to be running and ready, or succeeded: [logs-generator] E0324 08:40:59.512638 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:41:00.513007 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 08:41:01.435: INFO: Wanted all 1 pods to be running and ready, or succeeded. Result: true. Pods: [logs-generator] STEP: checking for a matching strings - test/e2e/kubectl/logs.go:121 @ 03/24/23 08:41:01.435 Mar 24 08:41:01.435: INFO: Running '/home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-logs-9382 logs logs-generator logs-generator' Mar 24 08:41:01.503: INFO: rc: 1 Mar 24 08:41:01.503: INFO: Unexpected error: <exec.CodeExitError>: error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-logs-9382 logs logs-generator logs-generator: Command stdout: stderr: Unable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer error: exit status 1 { Err: <*errors.errorString | 0xc0040b5e00>{ s: "error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-logs-9382 logs logs-generator logs-generator:\nCommand stdout:\n\nstderr:\nUnable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer\n\nerror:\nexit status 1", }, Code: 1, } [FAILED] error running /home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-logs-9382 logs logs-generator logs-generator: Command stdout: stderr: Unable to connect to the server: stream error: stream ID 3; INTERNAL_ERROR; received from peer error: exit status 1 In [It] at: test/e2e/framework/kubectl/builder.go:87 @ 03/24/23 08:41:01.504 < Exit [It] should be able to retrieve and filter logs [Conformance] - test/e2e/kubectl/logs.go:114 @ 03/24/23 08:41:01.504 (2.076s) > Enter [AfterEach] logs - test/e2e/kubectl/logs.go:99 @ 03/24/23 08:41:01.504 Mar 24 08:41:01.504: INFO: Running '/home/prow/go/src/k8s.io/kubernetes/_output/bin/kubectl --server=https://127.0.0.1:39221 --kubeconfig=/root/.kube/kind-test-config --namespace=kubectl-logs-9382 delete pod logs-generator' E0324 08:41:01.513728 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 08:41:02.459: INFO: stderr: "" Mar 24 08:41:02.459: INFO: stdout: "pod \"logs-generator\" deleted\n" < Exit [AfterEach] logs - test/e2e/kubectl/logs.go:99 @ 03/24/23 08:41:02.459 (955ms) > Enter [AfterEach] [sig-cli] Kubectl logs - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:41:02.459 Mar 24 08:41:02.459: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cli] Kubectl logs - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:41:02.462 (3ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl logs - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:41:02.462 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl logs - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:41:02.462 (0s) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl logs - dump namespaces | framework.go:209 @ 03/24/23 08:41:02.462 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:41:02.462 STEP: Collecting events from namespace "kubectl-logs-9382". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:41:02.462 STEP: Found 5 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:41:02.465 Mar 24 08:41:02.465: INFO: At 2023-03-24 08:40:59 +0000 UTC - event for logs-generator: {default-scheduler } Scheduled: Successfully assigned kubectl-logs-9382/logs-generator to kind-worker Mar 24 08:41:02.465: INFO: At 2023-03-24 08:40:59 +0000 UTC - event for logs-generator: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:41:02.465: INFO: At 2023-03-24 08:40:59 +0000 UTC - event for logs-generator: {kubelet kind-worker} Created: Created container logs-generator Mar 24 08:41:02.465: INFO: At 2023-03-24 08:40:59 +0000 UTC - event for logs-generator: {kubelet kind-worker} Started: Started container logs-generator Mar 24 08:41:02.465: INFO: At 2023-03-24 08:41:01 +0000 UTC - event for logs-generator: {kubelet kind-worker} Killing: Stopping container logs-generator Mar 24 08:41:02.467: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:41:02.467: INFO: Mar 24 08:41:02.470: INFO: Logging node info for node kind-control-plane Mar 24 08:41:02.472: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 15464 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:39:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:41:02.472: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:41:02.475: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:41:02.481: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container etcd ready: true, restart count 0 Mar 24 08:41:02.481: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:41:02.481: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:41:02.481: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:41:02.481: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:41:02.481: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:41:02.481: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container coredns ready: true, restart count 0 Mar 24 08:41:02.481: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container coredns ready: true, restart count 0 Mar 24 08:41:02.481: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.481: INFO: Container local-path-provisioner ready: true, restart count 0 E0324 08:41:02.521836 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 08:41:02.523: INFO: Latency metrics for node kind-control-plane Mar 24 08:41:02.523: INFO: Logging node info for node kind-worker Mar 24 08:41:02.526: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 15325 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:38:12 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:41:02.527: INFO: Logging kubelet events for node kind-worker Mar 24 08:41:02.530: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:41:02.535: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.535: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:41:02.535: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.535: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:41:02.535: INFO: pod-service-account-dbf3bead-0243-4853-b907-6d1fb0d54a5c started at 2023-03-24 08:40:56 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.535: INFO: Container test ready: true, restart count 0 Mar 24 08:41:02.567: INFO: Latency metrics for node kind-worker Mar 24 08:41:02.567: INFO: Logging node info for node kind-worker2 Mar 24 08:41:02.570: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 15349 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:38:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:41:02.570: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:41:02.574: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:41:02.578: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.578: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:41:02.578: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.578: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:41:02.578: INFO: pod-qos-class-9985d765-4074-4f00-8c2a-f66857ec21a6 started at 2023-03-24 08:39:55 +0000 UTC (0+1 container statuses recorded) Mar 24 08:41:02.578: INFO: Container agnhost ready: false, restart count 0 Mar 24 08:41:02.610: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:41:02.61 (148ms) < Exit [DeferCleanup (Each)] [sig-cli] Kubectl logs - dump namespaces | framework.go:209 @ 03/24/23 08:41:02.61 (148ms) > Enter [DeferCleanup (Each)] [sig-cli] Kubectl logs - tear down framework | framework.go:206 @ 03/24/23 08:41:02.611 STEP: Destroying namespace "kubectl-logs-9382" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:41:02.611 < Exit [DeferCleanup (Each)] [sig-cli] Kubectl logs - tear down framework | framework.go:206 @ 03/24/23 08:41:02.615 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:41:02.615 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:41:02.615 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sConntrack\sshould\sbe\sable\sto\spreserve\sUDP\straffic\swhen\sinitial\sunready\sendpoints\sget\sready$'
[FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-3259/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 1695; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:320 @ 03/24/23 08:01:31.588from junit_01.xml
> Enter [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 08:01:29.536 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:01:29.536 Mar 24 08:01:29.536: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename conntrack - test/e2e/framework/framework.go:250 @ 03/24/23 08:01:29.537 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:01:29.547 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:01:29.55 < Exit [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 08:01:29.553 (18ms) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:01:29.553 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:01:29.553 (0s) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 08:01:29.553 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 08:01:29.557 (3ms) > Enter [It] should be able to preserve UDP traffic when initial unready endpoints get ready - test/e2e/network/conntrack.go:295 @ 03/24/23 08:01:29.557 STEP: creating a UDP service svc-udp with type=ClusterIP in conntrack-3259 - test/e2e/network/conntrack.go:299 @ 03/24/23 08:01:29.557 STEP: creating a client pod for probing the service svc-udp - test/e2e/network/conntrack.go:309 @ 03/24/23 08:01:29.565 E0324 08:01:30.404873 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:01:31.405389 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 08:01:31.587: INFO: Unexpected error: <*url.Error | 0xc0038f4ea0>: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-3259/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 1695; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/conntrack-3259/pods/pod-client/log?container=pod-client&previous=false", Err: <http2.StreamError>{ StreamID: 1695, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-3259/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 1695; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:320 @ 03/24/23 08:01:31.588 < Exit [It] should be able to preserve UDP traffic when initial unready endpoints get ready - test/e2e/network/conntrack.go:295 @ 03/24/23 08:01:31.588 (2.031s) > Enter [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:01:31.588 Mar 24 08:01:31.588: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:01:31.591 (3ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:01:31.591 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:01:31.591 (0s) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 08:01:31.591 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:01:31.591 STEP: Collecting events from namespace "conntrack-3259". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:01:31.591 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:01:31.594 Mar 24 08:01:31.594: INFO: At 2023-03-24 08:01:29 +0000 UTC - event for pod-client: {default-scheduler } Scheduled: Successfully assigned conntrack-3259/pod-client to kind-worker Mar 24 08:01:31.594: INFO: At 2023-03-24 08:01:30 +0000 UTC - event for pod-client: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:01:31.594: INFO: At 2023-03-24 08:01:30 +0000 UTC - event for pod-client: {kubelet kind-worker} Created: Created container pod-client Mar 24 08:01:31.594: INFO: At 2023-03-24 08:01:30 +0000 UTC - event for pod-client: {kubelet kind-worker} Started: Started container pod-client Mar 24 08:01:31.596: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:01:31.596: INFO: pod-client kind-worker Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:01:29 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:01:30 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:01:30 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:01:29 +0000 UTC }] Mar 24 08:01:31.596: INFO: Mar 24 08:01:31.598: INFO: Unable to fetch conntrack-3259/pod-client/pod-client logs: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-3259/pods/pod-client/log?container=pod-client&previous=false&tailLines=42": stream error: stream ID 1703; INTERNAL_ERROR; received from peer Mar 24 08:01:31.601: INFO: Logging node info for node kind-control-plane Mar 24 08:01:31.603: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 5966 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 07:58:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:01:31.603: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:01:31.607: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:01:31.623: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:01:31.623: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:01:31.623: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container coredns ready: true, restart count 0 Mar 24 08:01:31.623: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container coredns ready: true, restart count 0 Mar 24 08:01:31.623: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:01:31.623: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container etcd ready: true, restart count 0 Mar 24 08:01:31.623: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:01:31.623: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:01:31.623: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.623: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:01:31.660: INFO: Latency metrics for node kind-control-plane Mar 24 08:01:31.660: INFO: Logging node info for node kind-worker Mar 24 08:01:31.664: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 5871 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 07:57:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:01:31.664: INFO: Logging kubelet events for node kind-worker Mar 24 08:01:31.668: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:01:31.680: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.680: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:01:31.680: INFO: rc-test-fd5lj started at 2023-03-24 08:01:28 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.680: INFO: Container rc-test ready: true, restart count 0 Mar 24 08:01:31.680: INFO: pod-client started at 2023-03-24 08:01:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.680: INFO: Container pod-client ready: true, restart count 0 Mar 24 08:01:31.680: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.680: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:01:31.716: INFO: Latency metrics for node kind-worker Mar 24 08:01:31.716: INFO: Logging node info for node kind-worker2 Mar 24 08:01:31.720: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 5875 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 07:57:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:01:31.720: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:01:31.724: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:01:31.735: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.735: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:01:31.735: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.735: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:01:31.735: INFO: rc-test-m8474 started at 2023-03-24 08:01:27 +0000 UTC (0+1 container statuses recorded) Mar 24 08:01:31.735: INFO: Container rc-test ready: true, restart count 0 Mar 24 08:01:31.774: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:01:31.774 (183ms) < Exit [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 08:01:31.774 (183ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 08:01:31.774 STEP: Destroying namespace "conntrack-3259" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:01:31.774 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 08:01:31.78 (6ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:01:31.78 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:01:31.78 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sConntrack\sshould\sbe\sable\sto\spreserve\sUDP\straffic\swhen\sserver\spod\scycles\sfor\sa\sClusterIP\sservice$'
[FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-7187/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 165; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:233 @ 03/24/23 07:59:24.456from junit_01.xml
> Enter [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 07:59:22.405 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 07:59:22.405 Mar 24 07:59:22.405: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename conntrack - test/e2e/framework/framework.go:250 @ 03/24/23 07:59:22.406 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 07:59:22.417 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 07:59:22.42 < Exit [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 07:59:22.423 (18ms) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 07:59:22.423 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 07:59:22.423 (0s) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 07:59:22.423 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 07:59:22.426 (3ms) > Enter [It] should be able to preserve UDP traffic when server pod cycles for a ClusterIP service - test/e2e/network/conntrack.go:208 @ 03/24/23 07:59:22.426 STEP: creating a UDP service svc-udp with type=ClusterIP in conntrack-7187 - test/e2e/network/conntrack.go:212 @ 03/24/23 07:59:22.426 STEP: creating a client pod for probing the service svc-udp - test/e2e/network/conntrack.go:222 @ 03/24/23 07:59:22.434 Mar 24 07:59:24.456: INFO: Unexpected error: <*url.Error | 0xc0043460c0>: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-7187/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 165; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/conntrack-7187/pods/pod-client/log?container=pod-client&previous=false", Err: <http2.StreamError>{ StreamID: 165, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-7187/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 165; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:233 @ 03/24/23 07:59:24.456 < Exit [It] should be able to preserve UDP traffic when server pod cycles for a ClusterIP service - test/e2e/network/conntrack.go:208 @ 03/24/23 07:59:24.456 (2.03s) > Enter [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 07:59:24.456 Mar 24 07:59:24.456: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 07:59:24.459 (3ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 07:59:24.459 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 07:59:24.459 (0s) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 07:59:24.459 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 07:59:24.459 STEP: Collecting events from namespace "conntrack-7187". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 07:59:24.459 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 07:59:24.462 Mar 24 07:59:24.462: INFO: At 2023-03-24 07:59:22 +0000 UTC - event for pod-client: {default-scheduler } Scheduled: Successfully assigned conntrack-7187/pod-client to kind-worker Mar 24 07:59:24.462: INFO: At 2023-03-24 07:59:22 +0000 UTC - event for pod-client: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 07:59:24.462: INFO: At 2023-03-24 07:59:22 +0000 UTC - event for pod-client: {kubelet kind-worker} Created: Created container pod-client Mar 24 07:59:24.462: INFO: At 2023-03-24 07:59:23 +0000 UTC - event for pod-client: {kubelet kind-worker} Started: Started container pod-client Mar 24 07:59:24.464: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 07:59:24.464: INFO: pod-client kind-worker Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:59:22 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:59:23 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:59:23 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 07:59:22 +0000 UTC }] Mar 24 07:59:24.464: INFO: Mar 24 07:59:24.465: INFO: Unable to fetch conntrack-7187/pod-client/pod-client logs: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-7187/pods/pod-client/log?container=pod-client&previous=false&tailLines=42": stream error: stream ID 173; INTERNAL_ERROR; received from peer Mar 24 07:59:24.468: INFO: Logging node info for node kind-control-plane Mar 24 07:59:24.471: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 5966 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 07:58:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:58:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 07:59:24.471: INFO: Logging kubelet events for node kind-control-plane Mar 24 07:59:24.474: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 07:59:24.489: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.489: INFO: Container etcd ready: true, restart count 0 Mar 24 07:59:24.489: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.489: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 07:59:24.490: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.490: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 07:59:24.490: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.490: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 07:59:24.490: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.490: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 07:59:24.490: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.490: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 07:59:24.490: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.490: INFO: Container coredns ready: true, restart count 0 Mar 24 07:59:24.490: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.490: INFO: Container coredns ready: true, restart count 0 Mar 24 07:59:24.490: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.490: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 07:59:24.527: INFO: Latency metrics for node kind-control-plane Mar 24 07:59:24.527: INFO: Logging node info for node kind-worker Mar 24 07:59:24.531: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 5871 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 07:57:35 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:57:35 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 07:59:24.531: INFO: Logging kubelet events for node kind-worker Mar 24 07:59:24.535: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 07:59:24.548: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.548: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 07:59:24.548: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.548: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 07:59:24.548: INFO: pod-client started at 2023-03-24 07:59:22 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.548: INFO: Container pod-client ready: true, restart count 0 Mar 24 07:59:24.586: INFO: Latency metrics for node kind-worker Mar 24 07:59:24.586: INFO: Logging node info for node kind-worker2 Mar 24 07:59:24.589: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 5875 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 07:57:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 07:57:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 07:59:24.589: INFO: Logging kubelet events for node kind-worker2 Mar 24 07:59:24.593: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 07:59:24.606: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.606: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 07:59:24.606: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 07:59:24.606: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 07:59:24.643: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 07:59:24.643 (184ms) < Exit [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 07:59:24.643 (184ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 07:59:24.643 STEP: Destroying namespace "conntrack-7187" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 07:59:24.643 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 07:59:24.648 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 07:59:24.648 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 07:59:24.648 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sConntrack\sshould\sbe\sable\sto\spreserve\sUDP\straffic\swhen\sserver\spod\scycles\sfor\sa\sNodePort\sservice$'
[FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1873/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 1657; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:157 @ 03/24/23 08:52:03.927from junit_01.xml
> Enter [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 08:52:01.873 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:52:01.873 Mar 24 08:52:01.873: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename conntrack - test/e2e/framework/framework.go:250 @ 03/24/23 08:52:01.874 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:52:01.884 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:52:01.888 < Exit [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 08:52:01.891 (19ms) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:52:01.891 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:52:01.891 (0s) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 08:52:01.891 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 08:52:01.895 (4ms) > Enter [It] should be able to preserve UDP traffic when server pod cycles for a NodePort service - test/e2e/network/conntrack.go:132 @ 03/24/23 08:52:01.895 STEP: creating a UDP service svc-udp with type=NodePort in conntrack-1873 - test/e2e/network/conntrack.go:136 @ 03/24/23 08:52:01.895 STEP: creating a client pod for probing the service svc-udp - test/e2e/network/conntrack.go:146 @ 03/24/23 08:52:01.905 E0324 08:52:02.860565 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:52:03.860837 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 08:52:03.927: INFO: Unexpected error: <*url.Error | 0xc006c276b0>: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1873/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 1657; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1873/pods/pod-client/log?container=pod-client&previous=false", Err: <http2.StreamError>{ StreamID: 1657, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1873/pods/pod-client/log?container=pod-client&previous=false": stream error: stream ID 1657; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:157 @ 03/24/23 08:52:03.927 < Exit [It] should be able to preserve UDP traffic when server pod cycles for a NodePort service - test/e2e/network/conntrack.go:132 @ 03/24/23 08:52:03.927 (2.032s) > Enter [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:52:03.927 Mar 24 08:52:03.927: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:52:03.93 (3ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:52:03.93 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:52:03.93 (0s) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 08:52:03.93 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:52:03.93 STEP: Collecting events from namespace "conntrack-1873". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:52:03.93 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:52:03.932 Mar 24 08:52:03.932: INFO: At 2023-03-24 08:52:01 +0000 UTC - event for pod-client: {default-scheduler } Scheduled: Successfully assigned conntrack-1873/pod-client to kind-worker Mar 24 08:52:03.932: INFO: At 2023-03-24 08:52:02 +0000 UTC - event for pod-client: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:52:03.932: INFO: At 2023-03-24 08:52:02 +0000 UTC - event for pod-client: {kubelet kind-worker} Created: Created container pod-client Mar 24 08:52:03.932: INFO: At 2023-03-24 08:52:02 +0000 UTC - event for pod-client: {kubelet kind-worker} Started: Started container pod-client Mar 24 08:52:03.935: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:52:03.935: INFO: pod-client kind-worker Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:52:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:52:03 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:52:03 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:52:01 +0000 UTC }] Mar 24 08:52:03.935: INFO: Mar 24 08:52:03.937: INFO: Unable to fetch conntrack-1873/pod-client/pod-client logs: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1873/pods/pod-client/log?container=pod-client&previous=false&tailLines=42": stream error: stream ID 1665; INTERNAL_ERROR; received from peer Mar 24 08:52:03.940: INFO: Logging node info for node kind-control-plane Mar 24 08:52:03.942: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 19302 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:49:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:52:03.942: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:52:03.945: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:52:03.951: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:03.951: INFO: Container etcd ready: true, restart count 0 Mar 24 08:52:03.951: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:03.951: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:52:03.951: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:03.951: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:52:03.951: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:03.951: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:52:03.951: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:03.951: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:52:03.951: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:03.951: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:52:03.951: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:03.951: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:52:03.995: INFO: Latency metrics for node kind-control-plane Mar 24 08:52:03.995: INFO: Logging node info for node kind-worker Mar 24 08:52:03.997: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 19510 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:51:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:52:03.998: INFO: Logging kubelet events for node kind-worker Mar 24 08:52:04.001: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:52:04.006: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:04.006: INFO: Container coredns ready: true, restart count 0 Mar 24 08:52:04.006: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:04.006: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:52:04.006: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:04.006: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:52:04.006: INFO: pod-client started at 2023-03-24 08:52:01 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:04.006: INFO: Container pod-client ready: true, restart count 0 Mar 24 08:52:04.041: INFO: Latency metrics for node kind-worker Mar 24 08:52:04.041: INFO: Logging node info for node kind-worker2 Mar 24 08:52:04.044: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 19190 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:48:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:52:04.044: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:52:04.047: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:52:04.052: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:04.052: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:52:04.052: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:04.052: INFO: Container coredns ready: true, restart count 0 Mar 24 08:52:04.052: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:52:04.052: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:52:04.092: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:52:04.092 (162ms) < Exit [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 08:52:04.092 (162ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 08:52:04.092 STEP: Destroying namespace "conntrack-1873" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:52:04.092 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 08:52:04.097 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:52:04.097 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:52:04.097 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sConntrack\sshould\sdrop\sINVALID\sconntrack\sentries\s\[Privileged\]$'
[FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1949/pods/boom-server/log?container=boom-server&previous=false": stream error: stream ID 2211; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:473 @ 03/24/23 10:02:18.303from junit_01.xml
> Enter [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 10:01:12.233 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:01:12.233 Mar 24 10:01:12.233: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename conntrack - test/e2e/framework/framework.go:250 @ 03/24/23 10:01:12.234 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:01:12.243 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:01:12.246 < Exit [BeforeEach] [sig-network] Conntrack - set up framework | framework.go:191 @ 03/24/23 10:01:12.249 (15ms) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:01:12.249 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:01:12.249 (0s) > Enter [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 10:01:12.249 < Exit [BeforeEach] [sig-network] Conntrack - test/e2e/network/conntrack.go:98 @ 03/24/23 10:01:12.252 (3ms) > Enter [It] should drop INVALID conntrack entries [Privileged] - test/e2e/network/conntrack.go:363 @ 03/24/23 10:01:12.252 E0324 10:01:12.822549 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:13.822945 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:14.823448 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:15.823722 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Server pod created on node kind-worker2 - test/e2e/network/conntrack.go:415 @ 03/24/23 10:01:16.273 STEP: Server service created - test/e2e/network/conntrack.go:434 @ 03/24/23 10:01:16.279 E0324 10:01:16.824373 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:17.824946 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Client pod created - test/e2e/network/conntrack.go:457 @ 03/24/23 10:01:18.296 STEP: checking client pod does not RST the TCP connection because it receives an INVALID packet - test/e2e/network/conntrack.go:464 @ 03/24/23 10:01:18.296 E0324 10:01:18.825304 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:19.825561 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:20.825952 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:21.826987 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:22.827707 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:23.827994 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:24.828014 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:25.828252 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:26.828481 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:27.828913 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:28.829087 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:29.829937 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:30.830924 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:31.831178 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:32.831837 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:33.832077 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:34.832316 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:35.832558 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:36.832796 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:37.833060 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:38.833331 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:39.833549 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:40.833796 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:41.834065 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:42.834754 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:43.835210 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:44.835498 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:45.836209 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:46.836496 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:47.836917 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:48.837185 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:49.837525 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:50.838034 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:51.838354 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:52.838889 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:53.839376 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:54.839652 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:55.839922 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:56.840174 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:57.840601 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:58.841580 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:01:59.841826 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:00.842073 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:01.842894 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:02.843580 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:03.843813 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:04.844129 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:05.844407 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:06.844596 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:07.845122 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:08.845302 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:09.845531 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:10.845795 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:11.845918 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:12.846055 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:13.846555 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:14.846793 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:15.847058 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:16.847312 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:02:17.847615 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 10:02:18.303: INFO: Unexpected error: <*url.Error | 0xc004a669c0>: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1949/pods/boom-server/log?container=boom-server&previous=false": stream error: stream ID 2211; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1949/pods/boom-server/log?container=boom-server&previous=false", Err: <http2.StreamError>{ StreamID: 2211, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1949/pods/boom-server/log?container=boom-server&previous=false": stream error: stream ID 2211; INTERNAL_ERROR; received from peer In [It] at: test/e2e/network/conntrack.go:473 @ 03/24/23 10:02:18.303 < Exit [It] should drop INVALID conntrack entries [Privileged] - test/e2e/network/conntrack.go:363 @ 03/24/23 10:02:18.303 (1m6.051s) > Enter [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:02:18.303 Mar 24 10:02:18.303: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-network] Conntrack - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:02:18.307 (3ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:02:18.307 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:02:18.307 (0s) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 10:02:18.307 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:02:18.307 STEP: Collecting events from namespace "conntrack-1949". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:02:18.307 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:02:18.309 Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:12 +0000 UTC - event for boom-server: {default-scheduler } Scheduled: Successfully assigned conntrack-1949/boom-server to kind-worker2 Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:12 +0000 UTC - event for boom-server: {kubelet kind-worker2} Pulling: Pulling image "registry.k8s.io/e2e-test-images/regression-issue-74839:1.2" Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:13 +0000 UTC - event for boom-server: {kubelet kind-worker2} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/regression-issue-74839:1.2" in 1.210922441s (1.210940603s including waiting) Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:13 +0000 UTC - event for boom-server: {kubelet kind-worker2} Created: Created container boom-server Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:14 +0000 UTC - event for boom-server: {kubelet kind-worker2} Started: Started container boom-server Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:16 +0000 UTC - event for startup-script: {default-scheduler } Scheduled: Successfully assigned conntrack-1949/startup-script to kind-worker Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:16 +0000 UTC - event for startup-script: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:16 +0000 UTC - event for startup-script: {kubelet kind-worker} Created: Created container startup-script Mar 24 10:02:18.309: INFO: At 2023-03-24 10:01:16 +0000 UTC - event for startup-script: {kubelet kind-worker} Started: Started container startup-script Mar 24 10:02:18.312: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:02:18.312: INFO: boom-server kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:12 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:15 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:15 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:12 +0000 UTC }] Mar 24 10:02:18.312: INFO: startup-script kind-worker Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:16 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:17 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:17 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:01:16 +0000 UTC }] Mar 24 10:02:18.312: INFO: Mar 24 10:02:18.313: INFO: Unable to fetch conntrack-1949/boom-server/boom-server logs: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1949/pods/boom-server/log?container=boom-server&previous=false&tailLines=42": stream error: stream ID 2219; INTERNAL_ERROR; received from peer Mar 24 10:02:18.315: INFO: Unable to fetch conntrack-1949/startup-script/startup-script logs: Get "https://127.0.0.1:39221/api/v1/namespaces/conntrack-1949/pods/startup-script/log?container=startup-script&previous=false&tailLines=42": stream error: stream ID 2221; INTERNAL_ERROR; received from peer Mar 24 10:02:18.318: INFO: Logging node info for node kind-control-plane Mar 24 10:02:18.320: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 36677 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:01:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:01:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:01:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:01:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:01:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:02:18.320: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:02:18.323: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:02:18.329: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.329: INFO: Container etcd ready: true, restart count 0 Mar 24 10:02:18.329: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.329: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:02:18.329: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.329: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:02:18.329: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.329: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:02:18.329: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.329: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:02:18.329: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.329: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:02:18.329: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.329: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:02:18.362: INFO: Latency metrics for node kind-control-plane Mar 24 10:02:18.362: INFO: Logging node info for node kind-worker Mar 24 10:02:18.364: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 35869 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-24 09:58:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:58:46 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:58:46 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:58:46 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:58:46 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:02:18.364: INFO: Logging kubelet events for node kind-worker Mar 24 10:02:18.368: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 10:02:18.372: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.372: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:02:18.372: INFO: coredns-5d78c9869d-h295t started at 2023-03-24 09:40:35 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.372: INFO: Container coredns ready: true, restart count 0 Mar 24 10:02:18.372: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.372: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:02:18.372: INFO: startup-script started at 2023-03-24 10:01:16 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.372: INFO: Container startup-script ready: true, restart count 0 Mar 24 10:02:18.404: INFO: Latency metrics for node kind-worker Mar 24 10:02:18.404: INFO: Logging node info for node kind-worker2 Mar 24 10:02:18.406: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 36955 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-03-24 10:01:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:01:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:01:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:01:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:01:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:02:18.407: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:02:18.410: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:02:18.414: INFO: boom-server started at 2023-03-24 10:01:12 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.414: INFO: Container boom-server ready: true, restart count 0 Mar 24 10:02:18.414: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.414: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:02:18.414: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.414: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:02:18.414: INFO: coredns-5d78c9869d-dtq4b started at 2023-03-24 09:40:35 +0000 UTC (0+1 container statuses recorded) Mar 24 10:02:18.414: INFO: Container coredns ready: true, restart count 0 Mar 24 10:02:18.445: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:02:18.445 (138ms) < Exit [DeferCleanup (Each)] [sig-network] Conntrack - dump namespaces | framework.go:209 @ 03/24/23 10:02:18.445 (139ms) > Enter [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 10:02:18.445 STEP: Destroying namespace "conntrack-1949" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:02:18.445 < Exit [DeferCleanup (Each)] [sig-network] Conntrack - tear down framework | framework.go:206 @ 03/24/23 10:02:18.45 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:02:18.45 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:02:18.45 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sConfigMap\sshould\sbe\sconsumable\svia\senvironment\svariable\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef for env-test: Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-6003/pods/pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef/log?container=env-test&previous=false": stream error: stream ID 5953; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:13:46.927from junit_01.xml
> Enter [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 09:13:42.878 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 09:13:42.878 Mar 24 09:13:42.878: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 09:13:42.879 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 09:13:42.889 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 09:13:42.892 < Exit [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 09:13:42.894 (17ms) > Enter [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:13:42.894 < Exit [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:13:42.894 (0s) > Enter [It] should be consumable via environment variable [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:45 @ 03/24/23 09:13:42.894 STEP: Creating configMap configmap-6003/configmap-test-29ed16f8-476f-477c-acaa-08e5b810d597 - test/e2e/common/node/configmap.go:48 @ 03/24/23 09:13:42.894 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 09:13:42.898 E0324 09:13:43.475515 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:13:44.475822 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:13:45.476363 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:13:46.476637 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 09:13:46.914 Mar 24 09:13:46.916: INFO: Trying to get logs from node kind-worker2 pod pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef container env-test: <nil> Mar 24 09:13:46.918: INFO: Failed to get logs from node "kind-worker2" pod "pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef" container "env-test". Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-6003/pods/pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef/log?container=env-test&previous=false": stream error: stream ID 5953; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 09:13:46.918 Mar 24 09:13:46.927: INFO: Unexpected error: <*fmt.wrapError | 0xc0014124e0>: failed to get logs from pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef for env-test: Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-6003/pods/pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef/log?container=env-test&previous=false": stream error: stream ID 5953; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef for env-test: Get \"https://127.0.0.1:39221/api/v1/namespaces/configmap-6003/pods/pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef/log?container=env-test&previous=false\": stream error: stream ID 5953; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0044c5560>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/configmap-6003/pods/pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 5953, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef for env-test: Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-6003/pods/pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef/log?container=env-test&previous=false": stream error: stream ID 5953; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:13:46.927 < Exit [It] should be consumable via environment variable [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:45 @ 03/24/23 09:13:46.927 (4.032s) > Enter [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:13:46.927 Mar 24 09:13:46.927: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:13:46.929 (3ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:13:46.929 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:13:46.929 (0s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 09:13:46.929 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:13:46.929 STEP: Collecting events from namespace "configmap-6003". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 09:13:46.929 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 09:13:46.932 Mar 24 09:13:46.932: INFO: At 2023-03-24 09:13:42 +0000 UTC - event for pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef: {default-scheduler } Scheduled: Successfully assigned configmap-6003/pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef to kind-worker2 Mar 24 09:13:46.932: INFO: At 2023-03-24 09:13:43 +0000 UTC - event for pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 09:13:46.932: INFO: At 2023-03-24 09:13:43 +0000 UTC - event for pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef: {kubelet kind-worker2} Created: Created container env-test Mar 24 09:13:46.932: INFO: At 2023-03-24 09:13:43 +0000 UTC - event for pod-configmaps-d898e7a4-06d7-48a8-b8aa-3cf4b62ffdef: {kubelet kind-worker2} Started: Started container env-test Mar 24 09:13:46.934: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 09:13:46.934: INFO: Mar 24 09:13:46.937: INFO: Logging node info for node kind-control-plane Mar 24 09:13:46.939: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 23508 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 09:10:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:10:02 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:10:02 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:10:02 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:10:02 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:13:46.939: INFO: Logging kubelet events for node kind-control-plane Mar 24 09:13:46.942: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 09:13:46.947: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:46.947: INFO: Container etcd ready: true, restart count 0 Mar 24 09:13:46.947: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:46.947: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 09:13:46.947: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:46.947: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 09:13:46.947: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:46.947: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:13:46.947: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:46.947: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 09:13:46.947: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:46.947: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:13:46.947: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:46.947: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 09:13:46.993: INFO: Latency metrics for node kind-control-plane Mar 24 09:13:46.993: INFO: Logging node info for node kind-worker Mar 24 09:13:46.996: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 23684 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 09:12:00 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:12:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:12:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:12:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:12:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:13:46.996: INFO: Logging kubelet events for node kind-worker Mar 24 09:13:46.999: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 09:13:47.004: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:47.004: INFO: Container coredns ready: true, restart count 0 Mar 24 09:13:47.004: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:47.004: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:13:47.004: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:47.004: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:13:47.035: INFO: Latency metrics for node kind-worker Mar 24 09:13:47.035: INFO: Logging node info for node kind-worker2 Mar 24 09:13:47.038: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 23418 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 09:09:03 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:09:03 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:09:03 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:09:03 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:09:03 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:13:47.038: INFO: Logging kubelet events for node kind-worker2 Mar 24 09:13:47.041: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 09:13:47.046: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:47.046: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:13:47.046: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:47.046: INFO: Container coredns ready: true, restart count 0 Mar 24 09:13:47.046: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 09:13:47.046: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:13:47.079: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:13:47.079 (150ms) < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 09:13:47.079 (150ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 09:13:47.079 STEP: Destroying namespace "configmap-6003" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 09:13:47.079 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 09:13:47.084 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:13:47.084 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:13:47.084 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sConfigMap\sshould\sbe\sconsumable\svia\sthe\senvironment\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352 for env-test: Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-4489/pods/pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352/log?container=env-test&previous=false": stream error: stream ID 527; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:27:51.431from junit_01.xml
> Enter [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 08:27:47.382 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:27:47.382 Mar 24 08:27:47.382: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 08:27:47.383 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:27:47.393 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:27:47.395 < Exit [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 08:27:47.398 (16ms) > Enter [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:27:47.398 < Exit [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:27:47.398 (0s) > Enter [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:93 @ 03/24/23 08:27:47.398 STEP: Creating configMap configmap-4489/configmap-test-c77348f2-2b56-4fce-a8ad-ba77831361cb - test/e2e/common/node/configmap.go:96 @ 03/24/23 08:27:47.398 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 08:27:47.402 E0324 08:27:48.132029 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:27:49.132916 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:27:50.133090 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:27:51.133372 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 08:27:51.417 Mar 24 08:27:51.419: INFO: Trying to get logs from node kind-worker2 pod pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352 container env-test: <nil> Mar 24 08:27:51.421: INFO: Failed to get logs from node "kind-worker2" pod "pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352" container "env-test". Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-4489/pods/pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352/log?container=env-test&previous=false": stream error: stream ID 527; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 08:27:51.421 Mar 24 08:27:51.430: INFO: Unexpected error: <*fmt.wrapError | 0xc005192ba0>: failed to get logs from pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352 for env-test: Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-4489/pods/pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352/log?container=env-test&previous=false": stream error: stream ID 527; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352 for env-test: Get \"https://127.0.0.1:39221/api/v1/namespaces/configmap-4489/pods/pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352/log?container=env-test&previous=false\": stream error: stream ID 527; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0031d4bd0>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/configmap-4489/pods/pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 527, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352 for env-test: Get "https://127.0.0.1:39221/api/v1/namespaces/configmap-4489/pods/pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352/log?container=env-test&previous=false": stream error: stream ID 527; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:27:51.431 < Exit [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:93 @ 03/24/23 08:27:51.431 (4.033s) > Enter [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:27:51.431 Mar 24 08:27:51.431: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:27:51.433 (3ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:27:51.433 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:27:51.433 (0s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 08:27:51.433 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:27:51.434 STEP: Collecting events from namespace "configmap-4489". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:27:51.434 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:27:51.436 Mar 24 08:27:51.436: INFO: At 2023-03-24 08:27:47 +0000 UTC - event for pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352: {default-scheduler } Scheduled: Successfully assigned configmap-4489/pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352 to kind-worker2 Mar 24 08:27:51.436: INFO: At 2023-03-24 08:27:47 +0000 UTC - event for pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 08:27:51.436: INFO: At 2023-03-24 08:27:47 +0000 UTC - event for pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352: {kubelet kind-worker2} Created: Created container env-test Mar 24 08:27:51.436: INFO: At 2023-03-24 08:27:47 +0000 UTC - event for pod-configmaps-890d73b3-a8a0-4640-9bbe-a2f60de6b352: {kubelet kind-worker2} Started: Started container env-test Mar 24 08:27:51.438: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:27:51.438: INFO: Mar 24 08:27:51.441: INFO: Logging node info for node kind-control-plane Mar 24 08:27:51.443: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 12462 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:24:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:27:51.444: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:27:51.447: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:27:51.460: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:27:51.460: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:27:51.460: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:27:51.460: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container coredns ready: true, restart count 0 Mar 24 08:27:51.460: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container coredns ready: true, restart count 0 Mar 24 08:27:51.460: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container etcd ready: true, restart count 0 Mar 24 08:27:51.460: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:27:51.460: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:27:51.460: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.460: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:27:51.502: INFO: Latency metrics for node kind-control-plane Mar 24 08:27:51.502: INFO: Logging node info for node kind-worker Mar 24 08:27:51.505: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 13089 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:22:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:22:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:22:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:22:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:22:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:27:51.505: INFO: Logging kubelet events for node kind-worker Mar 24 08:27:51.509: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:27:51.521: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.521: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:27:51.521: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.521: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:27:51.521: INFO: taint-eviction-4 started at 2023-03-24 08:26:32 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.521: INFO: Container pause ready: true, restart count 0 Mar 24 08:27:51.552: INFO: Latency metrics for node kind-worker Mar 24 08:27:51.552: INFO: Logging node info for node kind-worker2 Mar 24 08:27:51.555: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 12043 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:23:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:23:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:23:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:23:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:23:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:27:51.555: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:27:51.558: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:27:51.570: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.570: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:27:51.570: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:27:51.570: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:27:51.600: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:27:51.6 (166ms) < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 08:27:51.6 (166ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 08:27:51.6 STEP: Destroying namespace "configmap-4489" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:27:51.6 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 08:27:51.604 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:27:51.604 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:27:51.604 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc001078390>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 08:33:28.687from junit_01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 08:31:24.634 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:31:24.634 Mar 24 08:31:24.634: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 08:31:24.635 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:31:24.649 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:31:24.652 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 08:31:24.655 (21ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:31:24.655 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:31:24.655 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 08:31:24.655 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 08:31:24.657 E0324 08:31:25.235822 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:26.236464 71312 retrywatcher.go:130] "Watch failed" err="context canceled" < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 08:31:26.672 (2.018s) > Enter [It] should execute poststart exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:135 @ 03/24/23 08:31:26.672 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 08:31:26.672 E0324 08:31:27.236743 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:28.237392 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 08:31:28.685 E0324 08:31:29.238340 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:30.238672 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:31.238933 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:32.239125 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:33.239242 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:34.239649 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:35.239967 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:36.240696 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:37.241141 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:38.242053 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:39.242533 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:40.242879 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:41.243097 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:42.243621 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:43.243713 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:44.244137 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:45.244627 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:46.245166 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:47.245330 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:48.246066 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:49.246461 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:50.246988 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:51.247506 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:52.248115 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:53.249321 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:54.249500 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:55.250550 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:56.250698 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:57.251029 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:58.251710 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:31:59.252216 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:00.252746 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:01.253275 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:02.253895 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:03.254706 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:04.255168 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:05.255999 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:06.257136 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:07.257329 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:08.257727 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:09.258073 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:10.258797 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:11.258903 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:12.259529 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:13.260569 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:14.261037 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:15.261764 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:16.262749 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:17.262851 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:18.263574 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:19.264460 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:20.264905 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:21.265408 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:22.266144 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:23.266906 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:24.267108 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:25.267262 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:26.267927 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:27.268186 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:28.268875 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:29.269150 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:30.269584 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:31.269839 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:32.270230 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:33.271092 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:34.271767 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:35.272050 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:36.272585 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:37.273440 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:38.274328 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:39.275418 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:40.275472 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:41.276067 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:42.276469 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:43.277488 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:44.278138 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:45.278743 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:46.279062 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:47.279896 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:48.280781 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:49.280831 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:50.281790 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:51.282367 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:52.283350 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:53.284202 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:54.284708 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:55.285465 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:56.285977 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:57.286195 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:58.286626 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:32:59.287305 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:00.287959 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:01.288744 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:02.289580 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:03.290617 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:04.291003 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:05.291412 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:06.291891 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:07.292508 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:08.293258 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:09.293373 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:10.293558 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:11.294444 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:12.294976 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:13.295975 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:14.296729 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:15.296857 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:16.297562 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:17.297699 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:18.298628 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:19.299219 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:20.299609 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:21.300650 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:22.301424 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:23.301952 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:24.302194 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:25.302852 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:26.303038 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:27.303536 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:28.304182 71312 retrywatcher.go:130] "Watch failed" err="context canceled" [FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc001078390>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 08:33:28.687 < Exit [It] should execute poststart exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:135 @ 03/24/23 08:33:28.687 (2m2.014s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:33:28.687 Mar 24 08:33:28.687: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:33:28.69 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:33:28.69 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:33:28.69 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 08:33:28.69 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:33:28.69 STEP: Collecting events from namespace "container-lifecycle-hook-9867". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:33:28.69 STEP: Found 11 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:33:28.693 Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:24 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-9867/pod-handle-http-request to kind-worker2 Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:25 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:25 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-http-request Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:25 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-http-request Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:25 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:25 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-https-request Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:25 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-https-request Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:26 +0000 UTC - event for pod-with-poststart-exec-hook: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-9867/pod-with-poststart-exec-hook to kind-worker Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:27 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:27 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet kind-worker} Created: Created container pod-with-poststart-exec-hook Mar 24 08:33:28.693: INFO: At 2023-03-24 08:31:27 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet kind-worker} Started: Started container pod-with-poststart-exec-hook Mar 24 08:33:28.696: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:33:28.696: INFO: pod-handle-http-request kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:24 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:25 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:25 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:24 +0000 UTC }] Mar 24 08:33:28.696: INFO: pod-with-poststart-exec-hook kind-worker Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:26 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:28 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:28 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:31:26 +0000 UTC }] Mar 24 08:33:28.696: INFO: Mar 24 08:33:28.698: INFO: Unable to fetch container-lifecycle-hook-9867/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-9867/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 2111; INTERNAL_ERROR; received from peer Mar 24 08:33:28.700: INFO: Unable to fetch container-lifecycle-hook-9867/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-9867/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 2113; INTERNAL_ERROR; received from peer Mar 24 08:33:28.701: INFO: Unable to fetch container-lifecycle-hook-9867/pod-with-poststart-exec-hook/pod-with-poststart-exec-hook logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-9867/pods/pod-with-poststart-exec-hook/log?container=pod-with-poststart-exec-hook&previous=false&tailLines=42": stream error: stream ID 2115; INTERNAL_ERROR; received from peer Mar 24 08:33:28.704: INFO: Logging node info for node kind-control-plane Mar 24 08:33:28.706: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 13819 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:29:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:29:14 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:29:14 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:29:14 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:29:14 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:33:28.707: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:33:28.710: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:33:28.724: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container coredns ready: true, restart count 0 Mar 24 08:33:28.724: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container coredns ready: true, restart count 0 Mar 24 08:33:28.724: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:33:28.724: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:33:28.724: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:33:28.724: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:33:28.724: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:33:28.724: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container etcd ready: true, restart count 0 Mar 24 08:33:28.724: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.724: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:33:28.759: INFO: Latency metrics for node kind-control-plane Mar 24 08:33:28.759: INFO: Logging node info for node kind-worker Mar 24 08:33:28.762: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 14585 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:33:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:33:28.762: INFO: Logging kubelet events for node kind-worker Mar 24 08:33:28.767: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:33:28.781: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.781: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:33:28.781: INFO: pod-with-poststart-exec-hook started at 2023-03-24 08:31:26 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.781: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 08:33:28.781: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.781: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:33:28.816: INFO: Latency metrics for node kind-worker Mar 24 08:33:28.816: INFO: Logging node info for node kind-worker2 Mar 24 08:33:28.819: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 14609 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:33:19 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:33:28.819: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:33:28.823: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:33:28.837: INFO: pod-handle-http-request started at 2023-03-24 08:31:24 +0000 UTC (0+2 container statuses recorded) Mar 24 08:33:28.837: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 08:33:28.838: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 08:33:28.838: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.838: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:33:28.838: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:33:28.838: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:33:28.871: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:33:28.871 (181ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 08:33:28.872 (181ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 08:33:28.872 STEP: Destroying namespace "container-lifecycle-hook-9867" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:33:28.872 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 08:33:28.877 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:33:28.877 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:33:28.877 (0s)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc001480cd0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 08:35:39.901from junit_01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 08:33:35.854 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:33:35.854 Mar 24 08:33:35.854: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 08:33:35.855 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:33:35.864 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:33:35.867 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 08:33:35.869 (16ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:33:35.869 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:33:35.869 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 08:33:35.869 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 08:33:35.872 E0324 08:33:36.308471 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:37.308722 71312 retrywatcher.go:130] "Watch failed" err="context canceled" < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 08:33:37.887 (2.018s) > Enter [It] should execute poststart http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:168 @ 03/24/23 08:33:37.887 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 08:33:37.887 E0324 08:33:38.309684 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:39.309925 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 08:33:39.9 E0324 08:33:40.310348 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:41.311086 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:42.311242 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:43.312165 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:44.312783 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:45.313477 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:46.313846 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:47.314605 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:48.315452 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:49.315893 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:50.316470 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:51.317144 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:52.317343 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:53.318339 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:54.318878 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:55.319158 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:56.319796 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:57.320364 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:58.321256 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:33:59.321426 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:00.322010 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:01.322648 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:02.323009 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:03.324053 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:04.324618 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:05.325159 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:06.326053 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:07.326857 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:08.327501 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:09.327704 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:10.328432 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:11.328823 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:12.328994 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:13.329929 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:14.330297 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:15.330557 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:16.331015 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:17.331497 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:18.332201 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:19.332430 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:20.332602 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:21.333111 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:22.333851 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:23.334784 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:24.335144 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:25.335701 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:26.336319 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:27.336449 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:28.337107 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:29.337697 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:30.338086 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:31.338638 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:32.338897 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:33.339981 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:34.340307 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:35.340424 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:36.341059 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:37.341254 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:38.342056 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:39.342279 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:40.342742 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:41.343661 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:42.343971 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:43.344445 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:44.345525 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:45.345841 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:46.346697 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:47.347203 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:48.347437 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:49.347940 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:50.348419 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:51.348905 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:52.349252 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:53.349972 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:54.350532 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:55.351621 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:56.352484 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:57.353337 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:58.353993 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:34:59.354120 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:00.354783 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:01.354893 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:02.355566 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:03.355757 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:04.356238 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:05.356397 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:06.356571 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:07.357235 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:08.358057 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:09.358209 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:10.358612 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:11.358834 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:12.359328 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:13.360223 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:14.360370 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:15.360934 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:16.361086 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:17.361778 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:18.362343 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:19.362730 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:20.363616 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:21.364121 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:22.364925 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:23.365888 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:24.366579 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:25.367261 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:26.367322 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:27.367740 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:28.368047 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:29.368366 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:30.369127 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:31.369707 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:32.370416 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:33.371306 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:34.371719 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:35.371870 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:36.372197 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:37.372587 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:38.373203 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:35:39.374067 71312 retrywatcher.go:130] "Watch failed" err="context canceled" [FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc001480cd0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 08:35:39.901 < Exit [It] should execute poststart http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:168 @ 03/24/23 08:35:39.901 (2m2.014s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:35:39.901 Mar 24 08:35:39.901: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:35:39.904 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:35:39.904 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:35:39.904 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 08:35:39.904 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:35:39.904 STEP: Collecting events from namespace "container-lifecycle-hook-3712". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:35:39.904 STEP: Found 11 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:35:39.907 Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:35 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-3712/pod-handle-http-request to kind-worker2 Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-http-request Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-http-request Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-https-request Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-https-request Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:37 +0000 UTC - event for pod-with-poststart-http-hook: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-3712/pod-with-poststart-http-hook to kind-worker2 Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:38 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:38 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet kind-worker2} Created: Created container pod-with-poststart-http-hook Mar 24 08:35:39.907: INFO: At 2023-03-24 08:33:38 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet kind-worker2} Started: Started container pod-with-poststart-http-hook Mar 24 08:35:39.910: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:35:39.910: INFO: pod-handle-http-request kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:35 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:37 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:37 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:35 +0000 UTC }] Mar 24 08:35:39.910: INFO: pod-with-poststart-http-hook kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:37 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:39 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:39 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:33:37 +0000 UTC }] Mar 24 08:35:39.910: INFO: Mar 24 08:35:39.912: INFO: Unable to fetch container-lifecycle-hook-3712/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-3712/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 2557; INTERNAL_ERROR; received from peer Mar 24 08:35:39.913: INFO: Unable to fetch container-lifecycle-hook-3712/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-3712/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 2559; INTERNAL_ERROR; received from peer Mar 24 08:35:39.915: INFO: Unable to fetch container-lifecycle-hook-3712/pod-with-poststart-http-hook/pod-with-poststart-http-hook logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-3712/pods/pod-with-poststart-http-hook/log?container=pod-with-poststart-http-hook&previous=false&tailLines=42": stream error: stream ID 2561; INTERNAL_ERROR; received from peer Mar 24 08:35:39.918: INFO: Logging node info for node kind-control-plane Mar 24 08:35:39.920: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 14839 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:34:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:34:20 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:34:20 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:34:20 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:34:20 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:35:39.920: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:35:39.924: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:35:39.938: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:35:39.938: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:35:39.938: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:35:39.938: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container etcd ready: true, restart count 0 Mar 24 08:35:39.938: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:35:39.938: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container coredns ready: true, restart count 0 Mar 24 08:35:39.938: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container coredns ready: true, restart count 0 Mar 24 08:35:39.938: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:35:39.938: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.938: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:35:39.973: INFO: Latency metrics for node kind-control-plane Mar 24 08:35:39.973: INFO: Logging node info for node kind-worker Mar 24 08:35:39.975: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 14585 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:33:06 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:33:06 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:35:39.976: INFO: Logging kubelet events for node kind-worker Mar 24 08:35:39.979: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:35:39.989: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.989: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:35:39.989: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:39.989: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:35:40.017: INFO: Latency metrics for node kind-worker Mar 24 08:35:40.017: INFO: Logging node info for node kind-worker2 Mar 24 08:35:40.019: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 14609 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:33:19 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:33:19 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:35:40.019: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:35:40.023: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:35:40.033: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:40.033: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:35:40.033: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:40.033: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:35:40.033: INFO: pod-handle-http-request started at 2023-03-24 08:33:35 +0000 UTC (0+2 container statuses recorded) Mar 24 08:35:40.033: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 08:35:40.033: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 08:35:40.033: INFO: pod-with-poststart-http-hook started at 2023-03-24 08:33:37 +0000 UTC (0+1 container statuses recorded) Mar 24 08:35:40.033: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 08:35:40.070: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:35:40.07 (165ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 08:35:40.07 (165ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 08:35:40.07 STEP: Destroying namespace "container-lifecycle-hook-3712" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:35:40.07 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 08:35:40.074 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:35:40.074 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:35:40.074 (0s)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc001998560>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 09:22:52.505from junit_01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 09:22:14.438 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 09:22:14.438 Mar 24 09:22:14.438: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 09:22:14.439 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 09:22:14.449 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 09:22:14.452 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 09:22:14.456 (18ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:22:14.456 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:22:14.456 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 09:22:14.456 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 09:22:14.459 E0324 09:22:14.711884 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:15.712399 71312 retrywatcher.go:130] "Watch failed" err="context canceled" < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 09:22:16.475 (2.019s) > Enter [It] should execute prestop exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:152 @ 03/24/23 09:22:16.475 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 09:22:16.475 E0324 09:22:16.712534 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:17.713016 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 09:22:18.49 E0324 09:22:18.713276 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:19.714516 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:20.715373 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:21.715778 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 09:22:22.503 E0324 09:22:22.716043 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:23.716830 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:24.717888 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:25.718515 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:26.718932 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:27.719292 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:28.719850 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:29.720759 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:30.720961 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:31.721976 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:32.722916 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:33.722989 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:34.723562 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:35.724225 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:36.725195 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:37.726229 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:38.726697 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:39.727144 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:40.727652 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:41.728320 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:42.728402 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:43.729016 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:44.729171 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:45.729805 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:46.730228 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:47.730814 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:48.731568 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:49.731747 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:50.732235 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:22:51.732798 71312 retrywatcher.go:130] "Watch failed" err="context canceled" [FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc001998560>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 09:22:52.505 < Exit [It] should execute prestop exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:152 @ 03/24/23 09:22:52.505 (36.03s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:22:52.505 Mar 24 09:22:52.505: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:22:52.508 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:22:52.508 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:22:52.509 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 09:22:52.509 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:22:52.509 STEP: Collecting events from namespace "container-lifecycle-hook-9655". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 09:22:52.509 STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 09:22:52.511 Mar 24 09:22:52.511: INFO: At 2023-03-24 09:22:14 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-9655/pod-handle-http-request to kind-worker2 Mar 24 09:22:52.511: INFO: At 2023-03-24 09:22:14 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 09:22:52.511: INFO: At 2023-03-24 09:22:14 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-http-request Mar 24 09:22:52.511: INFO: At 2023-03-24 09:22:15 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-http-request Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:15 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:15 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-https-request Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:15 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-https-request Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:16 +0000 UTC - event for pod-with-prestop-exec-hook: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-9655/pod-with-prestop-exec-hook to kind-worker Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:16 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:16 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet kind-worker} Created: Created container pod-with-prestop-exec-hook Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:17 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet kind-worker} Started: Started container pod-with-prestop-exec-hook Mar 24 09:22:52.512: INFO: At 2023-03-24 09:22:20 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet kind-worker} Killing: Stopping container pod-with-prestop-exec-hook Mar 24 09:22:52.514: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 09:22:52.514: INFO: pod-handle-http-request kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 09:22:14 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 09:22:15 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 09:22:15 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 09:22:14 +0000 UTC }] Mar 24 09:22:52.514: INFO: Mar 24 09:22:52.516: INFO: Unable to fetch container-lifecycle-hook-9655/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-9655/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 7445; INTERNAL_ERROR; received from peer Mar 24 09:22:52.517: INFO: Unable to fetch container-lifecycle-hook-9655/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-9655/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 7447; INTERNAL_ERROR; received from peer Mar 24 09:22:52.520: INFO: Logging node info for node kind-control-plane Mar 24 09:22:52.522: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 25299 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 09:20:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:20:15 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:22:52.523: INFO: Logging kubelet events for node kind-control-plane Mar 24 09:22:52.525: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 09:22:52.538: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.538: INFO: Container etcd ready: true, restart count 0 Mar 24 09:22:52.538: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.538: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 09:22:52.538: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.538: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 09:22:52.538: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.538: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:22:52.538: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.538: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 09:22:52.538: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.538: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:22:52.538: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.538: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 09:22:52.575: INFO: Latency metrics for node kind-control-plane Mar 24 09:22:52.575: INFO: Logging node info for node kind-worker Mar 24 09:22:52.579: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 25678 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-24 09:21:10 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:21:10 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:21:10 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:21:10 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:21:10 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:22:52.579: INFO: Logging kubelet events for node kind-worker Mar 24 09:22:52.582: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 09:22:52.594: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.594: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:22:52.594: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.594: INFO: Container coredns ready: true, restart count 0 Mar 24 09:22:52.594: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.594: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:22:52.629: INFO: Latency metrics for node kind-worker Mar 24 09:22:52.629: INFO: Logging node info for node kind-worker2 Mar 24 09:22:52.632: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 25679 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-03-24 09:19:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:19:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:22:52.632: INFO: Logging kubelet events for node kind-worker2 Mar 24 09:22:52.635: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 09:22:52.649: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.649: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:22:52.649: INFO: pod-handle-http-request started at 2023-03-24 09:22:14 +0000 UTC (0+2 container statuses recorded) Mar 24 09:22:52.649: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 09:22:52.649: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 09:22:52.649: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.649: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:22:52.649: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:22:52.649: INFO: Container coredns ready: true, restart count 0 Mar 24 09:22:52.682: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:22:52.682 (173ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 09:22:52.682 (174ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 09:22:52.682 STEP: Destroying namespace "container-lifecycle-hook-9655" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 09:22:52.682 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 09:22:52.687 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:22:52.687 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:22:52.687 (0s)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 30.000s. Expected <*errors.errorString | 0xc005809b30>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 08:56:19.684from junit_01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 08:55:43.626 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:55:43.626 Mar 24 08:55:43.626: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 08:55:43.627 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:55:43.636 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:55:43.64 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 08:55:43.643 (16ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:55:43.643 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:55:43.643 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 08:55:43.643 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 08:55:43.646 E0324 08:55:43.973715 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:44.973818 71312 retrywatcher.go:130] "Watch failed" err="context canceled" < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 08:55:45.66 (2.017s) > Enter [It] should execute prestop http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:213 @ 03/24/23 08:55:45.66 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 08:55:45.66 E0324 08:55:45.974022 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:46.974298 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 08:55:47.673 E0324 08:55:47.974620 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:48.974845 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 08:55:49.684 E0324 08:55:49.975372 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:50.975934 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:51.976294 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:52.977290 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:53.978152 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:54.978679 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:55.979234 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:56.979364 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:57.979959 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:58.981054 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:55:59.981893 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:00.982350 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:01.982476 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:02.982540 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:03.982897 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:04.983002 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:05.983517 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:06.983790 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:07.984384 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:08.984823 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:09.985765 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:10.986355 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:11.986935 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:12.988025 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:13.988422 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:14.989317 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:15.989979 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:16.990932 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:17.991077 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:56:18.991636 71312 retrywatcher.go:130] "Watch failed" err="context canceled" [FAILED] Timed out after 30.000s. Expected <*errors.errorString | 0xc005809b30>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 08:56:19.684 < Exit [It] should execute prestop http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:213 @ 03/24/23 08:56:19.684 (34.025s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:56:19.684 Mar 24 08:56:19.684: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:56:19.688 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:56:19.688 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:56:19.688 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 08:56:19.688 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:56:19.688 STEP: Collecting events from namespace "container-lifecycle-hook-2208". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:56:19.688 STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:56:19.691 Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:43 +0000 UTC - event for pod-handle-http-request: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-2208/pod-handle-http-request to kind-worker2 Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:44 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:44 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-http-request Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:44 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-http-request Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:44 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:44 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Created: Created container container-handle-https-request Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:44 +0000 UTC - event for pod-handle-http-request: {kubelet kind-worker2} Started: Started container container-handle-https-request Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:45 +0000 UTC - event for pod-with-prestop-http-hook: {default-scheduler } Scheduled: Successfully assigned container-lifecycle-hook-2208/pod-with-prestop-http-hook to kind-worker2 Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:46 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:46 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet kind-worker2} Created: Created container pod-with-prestop-http-hook Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:46 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet kind-worker2} Started: Started container pod-with-prestop-http-hook Mar 24 08:56:19.691: INFO: At 2023-03-24 08:55:47 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet kind-worker2} Killing: Stopping container pod-with-prestop-http-hook Mar 24 08:56:19.694: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:56:19.694: INFO: pod-handle-http-request kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:55:43 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:55:45 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:55:45 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 08:55:43 +0000 UTC }] Mar 24 08:56:19.694: INFO: Mar 24 08:56:19.696: INFO: Unable to fetch container-lifecycle-hook-2208/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-2208/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 3577; INTERNAL_ERROR; received from peer Mar 24 08:56:19.698: INFO: Unable to fetch container-lifecycle-hook-2208/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:39221/api/v1/namespaces/container-lifecycle-hook-2208/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 3579; INTERNAL_ERROR; received from peer Mar 24 08:56:19.700: INFO: Logging node info for node kind-control-plane Mar 24 08:56:19.702: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 20860 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:54:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:54:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:54:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:54:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:54:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:56:19.703: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:56:19.705: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:56:19.710: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.710: INFO: Container etcd ready: true, restart count 0 Mar 24 08:56:19.710: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.710: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:56:19.710: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.710: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:56:19.710: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.710: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:56:19.710: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.710: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:56:19.710: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.710: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:56:19.710: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.710: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:56:19.742: INFO: Latency metrics for node kind-control-plane Mar 24 08:56:19.742: INFO: Logging node info for node kind-worker Mar 24 08:56:19.745: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 19510 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:51:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:56:19.745: INFO: Logging kubelet events for node kind-worker Mar 24 08:56:19.749: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:56:19.754: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.754: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:56:19.754: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.754: INFO: Container coredns ready: true, restart count 0 Mar 24 08:56:19.754: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.754: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:56:19.788: INFO: Latency metrics for node kind-worker Mar 24 08:56:19.788: INFO: Logging node info for node kind-worker2 Mar 24 08:56:19.791: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 20497 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:53:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:53:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:53:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:53:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:53:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:56:19.791: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:56:19.794: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:56:19.799: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.799: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:56:19.799: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.799: INFO: Container coredns ready: true, restart count 0 Mar 24 08:56:19.799: INFO: pod-handle-http-request started at 2023-03-24 08:55:43 +0000 UTC (0+2 container statuses recorded) Mar 24 08:56:19.799: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 08:56:19.799: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 08:56:19.799: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:56:19.799: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:56:19.848: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:56:19.848 (160ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 08:56:19.848 (160ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 08:56:19.848 STEP: Destroying namespace "container-lifecycle-hook-2208" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:56:19.848 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 08:56:19.853 (6ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:56:19.853 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:56:19.853 (0s)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\sarguments\s\(container\scmd\)\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-1988/pods/client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36/log?container=agnhost-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:31:52.708from junit_01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 09:31:48.644 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 09:31:48.644 Mar 24 09:31:48.644: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 09:31:48.645 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 09:31:48.658 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 09:31:48.663 < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 09:31:48.667 (24ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:31:48.667 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:31:48.667 (0s) > Enter [It] should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:61 @ 03/24/23 09:31:48.667 STEP: Creating a pod to test override arguments - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 09:31:48.667 E0324 09:31:48.995106 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:31:49.995675 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:31:50.995880 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:31:51.996194 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 09:31:52.687 Mar 24 09:31:52.692: INFO: Trying to get logs from node kind-worker pod client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36 container agnhost-container: <nil> Mar 24 09:31:52.694: INFO: Failed to get logs from node "kind-worker" pod "client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36" container "agnhost-container". Get "https://127.0.0.1:39221/api/v1/namespaces/containers-1988/pods/client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36/log?container=agnhost-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 09:31:52.694 Mar 24 09:31:52.707: INFO: Unexpected error: <*fmt.wrapError | 0xc006647460>: failed to get logs from client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-1988/pods/client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36/log?container=agnhost-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36 for agnhost-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/containers-1988/pods/client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36/log?container=agnhost-container&previous=false\": stream error: stream ID 1215; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0044c8c00>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/containers-1988/pods/client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1215, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-1988/pods/client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36/log?container=agnhost-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:31:52.708 < Exit [It] should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:61 @ 03/24/23 09:31:52.708 (4.04s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:31:52.708 Mar 24 09:31:52.708: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:31:52.712 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:31:52.712 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:31:52.712 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 09:31:52.712 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:31:52.712 STEP: Collecting events from namespace "containers-1988". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 09:31:52.712 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 09:31:52.715 Mar 24 09:31:52.716: INFO: At 2023-03-24 09:31:48 +0000 UTC - event for client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36: {default-scheduler } Scheduled: Successfully assigned containers-1988/client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36 to kind-worker Mar 24 09:31:52.716: INFO: At 2023-03-24 09:31:49 +0000 UTC - event for client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 09:31:52.716: INFO: At 2023-03-24 09:31:49 +0000 UTC - event for client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36: {kubelet kind-worker} Created: Created container agnhost-container Mar 24 09:31:52.716: INFO: At 2023-03-24 09:31:49 +0000 UTC - event for client-containers-3d39f17c-4ff6-4091-9fa9-d7db93f3ee36: {kubelet kind-worker} Started: Started container agnhost-container Mar 24 09:31:52.719: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 09:31:52.719: INFO: Mar 24 09:31:52.723: INFO: Logging node info for node kind-control-plane Mar 24 09:31:52.726: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 26982 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 09:30:29 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:30:29 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:30:29 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:30:29 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:30:29 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:31:52.726: INFO: Logging kubelet events for node kind-control-plane Mar 24 09:31:52.731: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 09:31:52.738: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.738: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 09:31:52.738: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.738: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:31:52.738: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.738: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 09:31:52.738: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.738: INFO: Container etcd ready: true, restart count 0 Mar 24 09:31:52.738: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.738: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 09:31:52.738: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.738: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 09:31:52.738: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.738: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:31:52.787: INFO: Latency metrics for node kind-control-plane Mar 24 09:31:52.787: INFO: Logging node info for node kind-worker Mar 24 09:31:52.792: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 27223 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-24 09:31:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:31:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:31:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:31:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:31:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:31:52.792: INFO: Logging kubelet events for node kind-worker Mar 24 09:31:52.797: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 09:31:52.804: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.804: INFO: Container coredns ready: true, restart count 0 Mar 24 09:31:52.804: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.804: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:31:52.804: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.804: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:31:52.850: INFO: Latency metrics for node kind-worker Mar 24 09:31:52.850: INFO: Logging node info for node kind-worker2 Mar 24 09:31:52.854: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 26710 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-03-24 09:29:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:29:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:29:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:29:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:29:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:31:52.855: INFO: Logging kubelet events for node kind-worker2 Mar 24 09:31:52.858: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 09:31:52.865: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.865: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:31:52.865: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.865: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:31:52.865: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:31:52.865: INFO: Container coredns ready: true, restart count 0 Mar 24 09:31:52.907: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:31:52.907 (195ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 09:31:52.907 (195ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 09:31:52.907 STEP: Destroying namespace "containers-1988" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 09:31:52.907 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 09:31:52.913 (6ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:31:52.913 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:31:52.913 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\s\(container\sentrypoint\)\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-6ad8f92c-b380-4918-935a-16f03db1945f for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-8348/pods/client-containers-6ad8f92c-b380-4918-935a-16f03db1945f/log?container=agnhost-container&previous=false": stream error: stream ID 281; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:09:24.4from junit_01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 08:09:20.353 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:09:20.353 Mar 24 08:09:20.353: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 08:09:20.354 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:09:20.363 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:09:20.366 < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 08:09:20.369 (16ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:09:20.369 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:09:20.369 (0s) > Enter [It] should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:75 @ 03/24/23 08:09:20.369 STEP: Creating a pod to test override command - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 08:09:20.369 E0324 08:09:20.629375 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:09:21.629703 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:09:22.630658 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:09:23.631408 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 08:09:24.386 Mar 24 08:09:24.388: INFO: Trying to get logs from node kind-worker pod client-containers-6ad8f92c-b380-4918-935a-16f03db1945f container agnhost-container: <nil> Mar 24 08:09:24.390: INFO: Failed to get logs from node "kind-worker" pod "client-containers-6ad8f92c-b380-4918-935a-16f03db1945f" container "agnhost-container". Get "https://127.0.0.1:39221/api/v1/namespaces/containers-8348/pods/client-containers-6ad8f92c-b380-4918-935a-16f03db1945f/log?container=agnhost-container&previous=false": stream error: stream ID 281; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 08:09:24.39 Mar 24 08:09:24.399: INFO: Unexpected error: <*fmt.wrapError | 0xc004411940>: failed to get logs from client-containers-6ad8f92c-b380-4918-935a-16f03db1945f for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-8348/pods/client-containers-6ad8f92c-b380-4918-935a-16f03db1945f/log?container=agnhost-container&previous=false": stream error: stream ID 281; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-6ad8f92c-b380-4918-935a-16f03db1945f for agnhost-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/containers-8348/pods/client-containers-6ad8f92c-b380-4918-935a-16f03db1945f/log?container=agnhost-container&previous=false\": stream error: stream ID 281; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc004413e90>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/containers-8348/pods/client-containers-6ad8f92c-b380-4918-935a-16f03db1945f/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 281, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-6ad8f92c-b380-4918-935a-16f03db1945f for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-8348/pods/client-containers-6ad8f92c-b380-4918-935a-16f03db1945f/log?container=agnhost-container&previous=false": stream error: stream ID 281; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:09:24.4 < Exit [It] should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:75 @ 03/24/23 08:09:24.4 (4.031s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:09:24.4 Mar 24 08:09:24.400: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:09:24.403 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:09:24.403 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:09:24.403 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 08:09:24.403 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:09:24.403 STEP: Collecting events from namespace "containers-8348". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:09:24.403 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:09:24.405 Mar 24 08:09:24.405: INFO: At 2023-03-24 08:09:20 +0000 UTC - event for client-containers-6ad8f92c-b380-4918-935a-16f03db1945f: {default-scheduler } Scheduled: Successfully assigned containers-8348/client-containers-6ad8f92c-b380-4918-935a-16f03db1945f to kind-worker Mar 24 08:09:24.405: INFO: At 2023-03-24 08:09:20 +0000 UTC - event for client-containers-6ad8f92c-b380-4918-935a-16f03db1945f: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:09:24.405: INFO: At 2023-03-24 08:09:20 +0000 UTC - event for client-containers-6ad8f92c-b380-4918-935a-16f03db1945f: {kubelet kind-worker} Created: Created container agnhost-container Mar 24 08:09:24.405: INFO: At 2023-03-24 08:09:20 +0000 UTC - event for client-containers-6ad8f92c-b380-4918-935a-16f03db1945f: {kubelet kind-worker} Started: Started container agnhost-container Mar 24 08:09:24.409: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:09:24.409: INFO: Mar 24 08:09:24.412: INFO: Logging node info for node kind-control-plane Mar 24 08:09:24.414: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 8711 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:08:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:08:49 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:08:49 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:08:49 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:08:49 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:09:24.415: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:09:24.418: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:09:24.424: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container etcd ready: true, restart count 0 Mar 24 08:09:24.424: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:09:24.424: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:09:24.424: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:09:24.424: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:09:24.424: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:09:24.424: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container coredns ready: true, restart count 0 Mar 24 08:09:24.424: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container coredns ready: true, restart count 0 Mar 24 08:09:24.424: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.424: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:09:24.458: INFO: Latency metrics for node kind-control-plane Mar 24 08:09:24.458: INFO: Logging node info for node kind-worker Mar 24 08:09:24.461: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 8174 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:07:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:07:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:07:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:07:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:07:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:09:24.461: INFO: Logging kubelet events for node kind-worker Mar 24 08:09:24.465: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:09:24.470: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.470: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:09:24.470: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.470: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:09:24.501: INFO: Latency metrics for node kind-worker Mar 24 08:09:24.501: INFO: Logging node info for node kind-worker2 Mar 24 08:09:24.503: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 8256 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:07:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:07:48 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:07:48 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:07:48 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:07:48 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:09:24.504: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:09:24.507: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:09:24.511: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.511: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:09:24.511: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:09:24.511: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:09:24.546: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:09:24.546 (143ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 08:09:24.546 (143ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 08:09:24.546 STEP: Destroying namespace "containers-8348" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:09:24.546 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 08:09:24.55 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:09:24.55 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:09:24.55 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\sand\sarguments\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-7415/pods/client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3/log?container=agnhost-container&previous=false": stream error: stream ID 1271; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:28:14.515from junit_01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 08:28:10.471 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:28:10.471 Mar 24 08:28:10.471: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 08:28:10.472 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:28:10.481 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:28:10.485 < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 08:28:10.488 (16ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:28:10.488 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:28:10.488 (0s) > Enter [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:89 @ 03/24/23 08:28:10.488 STEP: Creating a pod to test override all - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 08:28:10.488 E0324 08:28:11.143448 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:28:12.143555 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:28:13.144532 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:28:14.144581 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 08:28:14.503 Mar 24 08:28:14.505: INFO: Trying to get logs from node kind-worker2 pod client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3 container agnhost-container: <nil> Mar 24 08:28:14.507: INFO: Failed to get logs from node "kind-worker2" pod "client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3" container "agnhost-container". Get "https://127.0.0.1:39221/api/v1/namespaces/containers-7415/pods/client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3/log?container=agnhost-container&previous=false": stream error: stream ID 1271; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 08:28:14.507 Mar 24 08:28:14.515: INFO: Unexpected error: <*fmt.wrapError | 0xc004761a60>: failed to get logs from client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-7415/pods/client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3/log?container=agnhost-container&previous=false": stream error: stream ID 1271; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3 for agnhost-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/containers-7415/pods/client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3/log?container=agnhost-container&previous=false\": stream error: stream ID 1271; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00342fcb0>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/containers-7415/pods/client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1271, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3 for agnhost-container: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-7415/pods/client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3/log?container=agnhost-container&previous=false": stream error: stream ID 1271; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:28:14.515 < Exit [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:89 @ 03/24/23 08:28:14.515 (4.028s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:28:14.515 Mar 24 08:28:14.515: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:28:14.518 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:28:14.518 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:28:14.518 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 08:28:14.518 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:28:14.518 STEP: Collecting events from namespace "containers-7415". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:28:14.518 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:28:14.52 Mar 24 08:28:14.520: INFO: At 2023-03-24 08:28:10 +0000 UTC - event for client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3: {default-scheduler } Scheduled: Successfully assigned containers-7415/client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3 to kind-worker2 Mar 24 08:28:14.520: INFO: At 2023-03-24 08:28:10 +0000 UTC - event for client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 08:28:14.520: INFO: At 2023-03-24 08:28:10 +0000 UTC - event for client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3: {kubelet kind-worker2} Created: Created container agnhost-container Mar 24 08:28:14.520: INFO: At 2023-03-24 08:28:11 +0000 UTC - event for client-containers-2f96f477-adf0-499d-9959-ae2a5772cce3: {kubelet kind-worker2} Started: Started container agnhost-container Mar 24 08:28:14.522: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:28:14.522: INFO: Mar 24 08:28:14.525: INFO: Logging node info for node kind-control-plane Mar 24 08:28:14.527: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 12462 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:24:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:24:08 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:28:14.527: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:28:14.530: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:28:14.536: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container etcd ready: true, restart count 0 Mar 24 08:28:14.536: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:28:14.536: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:28:14.536: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:28:14.536: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:28:14.536: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:28:14.536: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container coredns ready: true, restart count 0 Mar 24 08:28:14.536: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container coredns ready: true, restart count 0 Mar 24 08:28:14.536: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.536: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:28:14.571: INFO: Latency metrics for node kind-control-plane Mar 24 08:28:14.571: INFO: Logging node info for node kind-worker Mar 24 08:28:14.573: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 13326 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:28:00 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:28:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:28:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:28:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:28:00 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:28:14.574: INFO: Logging kubelet events for node kind-worker Mar 24 08:28:14.577: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:28:14.581: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.581: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:28:14.581: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.581: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:28:14.610: INFO: Latency metrics for node kind-worker Mar 24 08:28:14.610: INFO: Logging node info for node kind-worker2 Mar 24 08:28:14.613: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 13568 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:28:13 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:28:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:28:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:28:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:28:13 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:28:14.613: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:28:14.617: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:28:14.621: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.621: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:28:14.621: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:28:14.621: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:28:14.648: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:28:14.648 (130ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 08:28:14.648 (130ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 08:28:14.648 STEP: Destroying namespace "containers-7415" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:28:14.648 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 08:28:14.652 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:28:14.652 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:28:14.652 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\suse\sthe\simage\sdefaults\sif\scommand\sand\sargs\sare\sblank\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 3.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc004e262d0>: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-3703/pods/client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688/log?container=agnhost-container&previous=false": stream error: stream ID 263; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/containers-3703/pods/client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 263, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/node/containers.go:53 @ 03/24/23 10:12:09.177from junit_01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 10:12:04.131 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:12:04.131 Mar 24 10:12:04.131: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 10:12:04.133 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:12:04.143 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:12:04.146 < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 10:12:04.149 (18ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:12:04.149 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:12:04.149 (0s) > Enter [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:41 @ 03/24/23 10:12:04.149 E0324 10:12:05.131325 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:12:06.131668 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:12:07.132232 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:12:08.132629 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:12:09.133493 71312 retrywatcher.go:130] "Watch failed" err="context canceled" [FAILED] Timed out after 3.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc004e262d0>: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-3703/pods/client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688/log?container=agnhost-container&previous=false": stream error: stream ID 263; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/containers-3703/pods/client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 263, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/node/containers.go:53 @ 03/24/23 10:12:09.177 < Exit [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:41 @ 03/24/23 10:12:09.177 (5.027s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:12:09.177 Mar 24 10:12:09.177: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:12:09.181 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:12:09.181 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:12:09.181 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 10:12:09.181 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:12:09.181 STEP: Collecting events from namespace "containers-3703". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:12:09.181 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:12:09.185 Mar 24 10:12:09.185: INFO: At 2023-03-24 10:12:04 +0000 UTC - event for client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688: {default-scheduler } Scheduled: Successfully assigned containers-3703/client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688 to kind-worker2 Mar 24 10:12:09.185: INFO: At 2023-03-24 10:12:04 +0000 UTC - event for client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 10:12:09.185: INFO: At 2023-03-24 10:12:04 +0000 UTC - event for client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688: {kubelet kind-worker2} Created: Created container agnhost-container Mar 24 10:12:09.185: INFO: At 2023-03-24 10:12:04 +0000 UTC - event for client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688: {kubelet kind-worker2} Started: Started container agnhost-container Mar 24 10:12:09.188: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:12:09.188: INFO: client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688 kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:12:04 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:12:05 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:12:05 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:12:04 +0000 UTC }] Mar 24 10:12:09.188: INFO: Mar 24 10:12:09.190: INFO: Unable to fetch containers-3703/client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688/agnhost-container logs: Get "https://127.0.0.1:39221/api/v1/namespaces/containers-3703/pods/client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 271; INTERNAL_ERROR; received from peer Mar 24 10:12:09.198: INFO: Logging node info for node kind-control-plane Mar 24 10:12:09.201: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 40966 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:11:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:12:09.202: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:12:09.207: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:12:09.219: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.219: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:12:09.219: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.219: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:12:09.219: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.219: INFO: Container etcd ready: true, restart count 0 Mar 24 10:12:09.219: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.219: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:12:09.219: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.219: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:12:09.219: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.219: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:12:09.219: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.219: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:12:09.278: INFO: Latency metrics for node kind-control-plane Mar 24 10:12:09.278: INFO: Logging node info for node kind-worker Mar 24 10:12:09.282: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 41028 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-24 10:08:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:08:58 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:08:58 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:08:58 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:08:58 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:12:09.283: INFO: Logging kubelet events for node kind-worker Mar 24 10:12:09.291: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 10:12:09.302: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.302: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:12:09.302: INFO: coredns-5d78c9869d-g8gjd started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.302: INFO: Container coredns ready: true, restart count 0 Mar 24 10:12:09.302: INFO: pod0-1-sched-preemption-medium-priority started at 2023-03-24 10:11:58 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.302: INFO: Container pod0-1-sched-preemption-medium-priority ready: true, restart count 0 Mar 24 10:12:09.302: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.302: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:12:09.368: INFO: Latency metrics for node kind-worker Mar 24 10:12:09.368: INFO: Logging node info for node kind-worker2 Mar 24 10:12:09.371: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 41034 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-03-24 10:08:39 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:08:39 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:08:39 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:08:39 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:08:39 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:12:09.371: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:12:09.376: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:12:09.382: INFO: pod1-1-sched-preemption-medium-priority started at 2023-03-24 10:11:58 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.382: INFO: Container pod1-1-sched-preemption-medium-priority ready: true, restart count 0 Mar 24 10:12:09.382: INFO: pod1-0-sched-preemption-medium-priority started at 2023-03-24 10:11:58 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.382: INFO: Container pod1-0-sched-preemption-medium-priority ready: true, restart count 0 Mar 24 10:12:09.382: INFO: coredns-5d78c9869d-q87g7 started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.382: INFO: Container coredns ready: true, restart count 0 Mar 24 10:12:09.382: INFO: client-containers-4dfb16cc-b43f-4d44-bd68-4ea88e50d688 started at 2023-03-24 10:12:04 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.382: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 10:12:09.382: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.382: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:12:09.382: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:12:09.382: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:12:09.425: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:12:09.425 (244ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 10:12:09.425 (244ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 10:12:09.425 STEP: Destroying namespace "containers-3703" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:12:09.425 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 10:12:09.431 (6ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:12:09.431 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:12:09.431 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\scontainer\'s\slimits\.cpu\/memory\sand\srequests\.cpu\/memory\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1027/pods/downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6/log?container=dapi-container&previous=false": stream error: stream ID 2327; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:53:12.816from junit_01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 08:53:08.765 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:53:08.765 Mar 24 08:53:08.765: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 08:53:08.766 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:53:08.777 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:53:08.781 < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 08:53:08.784 (20ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:53:08.784 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:53:08.784 (0s) > Enter [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:167 @ 03/24/23 08:53:08.784 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 08:53:08.784 E0324 08:53:08.895909 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:53:09.896144 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:53:10.896758 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:53:11.897145 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 08:53:12.8 Mar 24 08:53:12.803: INFO: Trying to get logs from node kind-worker2 pod downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6 container dapi-container: <nil> Mar 24 08:53:12.805: INFO: Failed to get logs from node "kind-worker2" pod "downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6" container "dapi-container". Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1027/pods/downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6/log?container=dapi-container&previous=false": stream error: stream ID 2327; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 08:53:12.805 Mar 24 08:53:12.816: INFO: Unexpected error: <*fmt.wrapError | 0xc005aec340>: failed to get logs from downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1027/pods/downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6/log?container=dapi-container&previous=false": stream error: stream ID 2327; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6 for dapi-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/downward-api-1027/pods/downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6/log?container=dapi-container&previous=false\": stream error: stream ID 2327; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc003cb4270>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1027/pods/downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 2327, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1027/pods/downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6/log?container=dapi-container&previous=false": stream error: stream ID 2327; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:53:12.816 < Exit [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:167 @ 03/24/23 08:53:12.816 (4.032s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:53:12.816 Mar 24 08:53:12.816: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:53:12.819 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:53:12.819 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:53:12.819 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 08:53:12.819 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:53:12.819 STEP: Collecting events from namespace "downward-api-1027". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:53:12.819 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:53:12.822 Mar 24 08:53:12.822: INFO: At 2023-03-24 08:53:08 +0000 UTC - event for downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6: {default-scheduler } Scheduled: Successfully assigned downward-api-1027/downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6 to kind-worker2 Mar 24 08:53:12.822: INFO: At 2023-03-24 08:53:09 +0000 UTC - event for downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 08:53:12.822: INFO: At 2023-03-24 08:53:09 +0000 UTC - event for downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6: {kubelet kind-worker2} Created: Created container dapi-container Mar 24 08:53:12.822: INFO: At 2023-03-24 08:53:09 +0000 UTC - event for downward-api-4a0a116a-aa35-4951-8b83-e32c4f0c75c6: {kubelet kind-worker2} Started: Started container dapi-container Mar 24 08:53:12.824: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:53:12.824: INFO: Mar 24 08:53:12.826: INFO: Logging node info for node kind-control-plane Mar 24 08:53:12.829: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 19302 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:49:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:49:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:53:12.829: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:53:12.832: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:53:12.838: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.838: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:53:12.838: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.838: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:53:12.838: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.838: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:53:12.838: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.838: INFO: Container etcd ready: true, restart count 0 Mar 24 08:53:12.838: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.838: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:53:12.838: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.838: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:53:12.838: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.838: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:53:12.869: INFO: Latency metrics for node kind-control-plane Mar 24 08:53:12.869: INFO: Logging node info for node kind-worker Mar 24 08:53:12.872: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 19510 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:51:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:51:36 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:53:12.872: INFO: Logging kubelet events for node kind-worker Mar 24 08:53:12.875: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:53:12.880: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.880: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:53:12.880: INFO: test-new-deployment-67bd4bf6dc-zc66x started at 2023-03-24 08:53:06 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.880: INFO: Container httpd ready: true, restart count 0 Mar 24 08:53:12.880: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.880: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:53:12.880: INFO: pod-exec-websocket-55a035e1-ee26-4710-acbd-fac1c46701b7 started at 2023-03-24 08:53:03 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.880: INFO: Container main ready: true, restart count 0 Mar 24 08:53:12.880: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.880: INFO: Container coredns ready: true, restart count 0 E0324 08:53:12.898008 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 08:53:12.912: INFO: Latency metrics for node kind-worker Mar 24 08:53:12.912: INFO: Logging node info for node kind-worker2 Mar 24 08:53:12.915: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 19190 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:48:37 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:48:37 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:53:12.915: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:53:12.918: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:53:12.923: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.923: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:53:12.923: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.923: INFO: Container coredns ready: true, restart count 0 Mar 24 08:53:12.923: INFO: test-new-deployment-67bd4bf6dc-7w74g started at 2023-03-24 08:53:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.923: INFO: Container httpd ready: false, restart count 0 Mar 24 08:53:12.923: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:53:12.923: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:53:12.957: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:53:12.957 (138ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 08:53:12.957 (138ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 08:53:12.957 STEP: Destroying namespace "downward-api-1027" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:53:12.957 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 08:53:12.961 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:53:12.961 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:53:12.961 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\sdefault\slimits\.cpu\/memory\sfrom\snode\sallocatable\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1806/pods/downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574/log?container=dapi-container&previous=false": stream error: stream ID 1405; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:17:48.244from junit_01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 08:17:44.196 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:17:44.196 Mar 24 08:17:44.196: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 08:17:44.197 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:17:44.206 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:17:44.209 < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 08:17:44.212 (16ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:17:44.212 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:17:44.212 (0s) > Enter [It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:218 @ 03/24/23 08:17:44.212 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 08:17:44.212 E0324 08:17:44.864181 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:17:45.864646 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:17:46.865003 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:17:47.865799 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 08:17:48.229 Mar 24 08:17:48.232: INFO: Trying to get logs from node kind-worker2 pod downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574 container dapi-container: <nil> Mar 24 08:17:48.234: INFO: Failed to get logs from node "kind-worker2" pod "downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574" container "dapi-container". Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1806/pods/downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574/log?container=dapi-container&previous=false": stream error: stream ID 1405; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 08:17:48.234 Mar 24 08:17:48.244: INFO: Unexpected error: <*fmt.wrapError | 0xc0043f7140>: failed to get logs from downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1806/pods/downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574/log?container=dapi-container&previous=false": stream error: stream ID 1405; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574 for dapi-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/downward-api-1806/pods/downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574/log?container=dapi-container&previous=false\": stream error: stream ID 1405; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00310a6f0>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1806/pods/downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1405, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-1806/pods/downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574/log?container=dapi-container&previous=false": stream error: stream ID 1405; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:17:48.244 < Exit [It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:218 @ 03/24/23 08:17:48.244 (4.032s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:17:48.244 Mar 24 08:17:48.244: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:17:48.246 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:17:48.246 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:17:48.247 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 08:17:48.247 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:17:48.247 STEP: Collecting events from namespace "downward-api-1806". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:17:48.247 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:17:48.249 Mar 24 08:17:48.249: INFO: At 2023-03-24 08:17:44 +0000 UTC - event for downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574: {default-scheduler } Scheduled: Successfully assigned downward-api-1806/downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574 to kind-worker2 Mar 24 08:17:48.249: INFO: At 2023-03-24 08:17:44 +0000 UTC - event for downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 08:17:48.249: INFO: At 2023-03-24 08:17:44 +0000 UTC - event for downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574: {kubelet kind-worker2} Created: Created container dapi-container Mar 24 08:17:48.249: INFO: At 2023-03-24 08:17:44 +0000 UTC - event for downward-api-4ec5bb7e-5983-4292-a0f1-51b25165b574: {kubelet kind-worker2} Started: Started container dapi-container Mar 24 08:17:48.251: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:17:48.251: INFO: Mar 24 08:17:48.253: INFO: Logging node info for node kind-control-plane Mar 24 08:17:48.255: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 9984 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:13:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:13:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:13:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:13:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:13:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:17:48.256: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:17:48.259: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:17:48.265: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:17:48.265: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:17:48.265: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:17:48.265: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container etcd ready: true, restart count 0 Mar 24 08:17:48.265: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:17:48.265: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container coredns ready: true, restart count 0 Mar 24 08:17:48.265: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container coredns ready: true, restart count 0 Mar 24 08:17:48.265: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:17:48.265: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.265: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:17:48.299: INFO: Latency metrics for node kind-control-plane Mar 24 08:17:48.299: INFO: Logging node info for node kind-worker Mar 24 08:17:48.302: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 10313 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:12:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:12:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:12:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:12:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:12:43 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:17:48.302: INFO: Logging kubelet events for node kind-worker Mar 24 08:17:48.305: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:17:48.309: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.309: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:17:48.309: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.309: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:17:48.338: INFO: Latency metrics for node kind-worker Mar 24 08:17:48.338: INFO: Logging node info for node kind-worker2 Mar 24 08:17:48.341: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 9891 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:12:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:12:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:12:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:12:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:12:54 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:17:48.341: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:17:48.344: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:17:48.348: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.348: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:17:48.348: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:17:48.348: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:17:48.382: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:17:48.382 (136ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 08:17:48.382 (136ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 08:17:48.382 STEP: Destroying namespace "downward-api-1806" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:17:48.382 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 08:17:48.389 (6ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:17:48.389 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:17:48.389 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\shost\sIP\sas\san\senv\svar\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-4acac366-5d5c-4a50-992c-895bca671d8b for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-6342/pods/downward-api-4acac366-5d5c-4a50-992c-895bca671d8b/log?container=dapi-container&previous=false": stream error: stream ID 27; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:40:43.207from junit_01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 08:40:41.165 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 08:40:41.166 Mar 24 08:40:41.166: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 08:40:41.167 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 08:40:41.175 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 08:40:41.178 < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 08:40:41.181 (15ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:40:41.181 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 08:40:41.181 (0s) > Enter [It] should provide host IP as an env var [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:91 @ 03/24/23 08:40:41.181 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 08:40:41.181 E0324 08:40:41.503051 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 08:40:42.503548 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 08:40:43.192 Mar 24 08:40:43.195: INFO: Trying to get logs from node kind-worker2 pod downward-api-4acac366-5d5c-4a50-992c-895bca671d8b container dapi-container: <nil> Mar 24 08:40:43.196: INFO: Failed to get logs from node "kind-worker2" pod "downward-api-4acac366-5d5c-4a50-992c-895bca671d8b" container "dapi-container". Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-6342/pods/downward-api-4acac366-5d5c-4a50-992c-895bca671d8b/log?container=dapi-container&previous=false": stream error: stream ID 27; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 08:40:43.196 Mar 24 08:40:43.207: INFO: Unexpected error: <*fmt.wrapError | 0xc004ce2b60>: failed to get logs from downward-api-4acac366-5d5c-4a50-992c-895bca671d8b for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-6342/pods/downward-api-4acac366-5d5c-4a50-992c-895bca671d8b/log?container=dapi-container&previous=false": stream error: stream ID 27; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-4acac366-5d5c-4a50-992c-895bca671d8b for dapi-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/downward-api-6342/pods/downward-api-4acac366-5d5c-4a50-992c-895bca671d8b/log?container=dapi-container&previous=false\": stream error: stream ID 27; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00491ae40>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/downward-api-6342/pods/downward-api-4acac366-5d5c-4a50-992c-895bca671d8b/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 27, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-4acac366-5d5c-4a50-992c-895bca671d8b for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-6342/pods/downward-api-4acac366-5d5c-4a50-992c-895bca671d8b/log?container=dapi-container&previous=false": stream error: stream ID 27; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 08:40:43.207 < Exit [It] should provide host IP as an env var [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:91 @ 03/24/23 08:40:43.207 (2.026s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:40:43.207 Mar 24 08:40:43.207: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 08:40:43.21 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:40:43.21 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 08:40:43.21 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 08:40:43.21 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:40:43.21 STEP: Collecting events from namespace "downward-api-6342". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 08:40:43.21 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 08:40:43.212 Mar 24 08:40:43.212: INFO: At 2023-03-24 08:40:41 +0000 UTC - event for downward-api-4acac366-5d5c-4a50-992c-895bca671d8b: {default-scheduler } Scheduled: Successfully assigned downward-api-6342/downward-api-4acac366-5d5c-4a50-992c-895bca671d8b to kind-worker2 Mar 24 08:40:43.212: INFO: At 2023-03-24 08:40:41 +0000 UTC - event for downward-api-4acac366-5d5c-4a50-992c-895bca671d8b: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 08:40:43.212: INFO: At 2023-03-24 08:40:41 +0000 UTC - event for downward-api-4acac366-5d5c-4a50-992c-895bca671d8b: {kubelet kind-worker2} Created: Created container dapi-container Mar 24 08:40:43.212: INFO: At 2023-03-24 08:40:41 +0000 UTC - event for downward-api-4acac366-5d5c-4a50-992c-895bca671d8b: {kubelet kind-worker2} Started: Started container dapi-container Mar 24 08:40:43.214: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 08:40:43.214: INFO: Mar 24 08:40:43.217: INFO: Logging node info for node kind-control-plane Mar 24 08:40:43.219: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 15464 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:39:26 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:39:26 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:40:43.220: INFO: Logging kubelet events for node kind-control-plane Mar 24 08:40:43.222: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 08:40:43.229: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container etcd ready: true, restart count 0 Mar 24 08:40:43.229: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 08:40:43.229: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 08:40:43.229: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:40:43.229: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 08:40:43.229: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 08:40:43.229: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:40:43.229: INFO: coredns-5d78c9869d-t8vzq started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container coredns ready: true, restart count 0 Mar 24 08:40:43.229: INFO: coredns-5d78c9869d-m6m4l started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.229: INFO: Container coredns ready: true, restart count 0 Mar 24 08:40:43.272: INFO: Latency metrics for node kind-control-plane Mar 24 08:40:43.272: INFO: Logging node info for node kind-worker Mar 24 08:40:43.278: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 15325 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:38:12 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:38:12 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:40:43.278: INFO: Logging kubelet events for node kind-worker Mar 24 08:40:43.281: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 08:40:43.286: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.286: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:40:43.286: INFO: pod-init-590a2ca4-8f25-4e17-94ca-45397aeba28d started at 2023-03-24 08:39:55 +0000 UTC (2+1 container statuses recorded) Mar 24 08:40:43.286: INFO: Init container init1 ready: false, restart count 3 Mar 24 08:40:43.286: INFO: Init container init2 ready: false, restart count 0 Mar 24 08:40:43.286: INFO: Container run1 ready: false, restart count 0 Mar 24 08:40:43.286: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.286: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:40:43.316: INFO: Latency metrics for node kind-worker Mar 24 08:40:43.316: INFO: Logging node info for node kind-worker2 Mar 24 08:40:43.319: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 15349 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:38:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:38:25 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 08:40:43.319: INFO: Logging kubelet events for node kind-worker2 Mar 24 08:40:43.322: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 08:40:43.327: INFO: pod-qos-class-9985d765-4074-4f00-8c2a-f66857ec21a6 started at 2023-03-24 08:39:55 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.327: INFO: Container agnhost ready: false, restart count 0 Mar 24 08:40:43.327: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.327: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 08:40:43.327: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 08:40:43.327: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 08:40:43.358: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 08:40:43.358 (148ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 08:40:43.358 (148ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 08:40:43.358 STEP: Destroying namespace "downward-api-6342" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 08:40:43.358 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 08:40:43.362 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:40:43.363 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 08:40:43.363 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\spod\sUID\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-8278/pods/downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3/log?container=dapi-container&previous=false": stream error: stream ID 1863; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:37:38.084from junit_01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 09:37:34.038 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 09:37:34.038 Mar 24 09:37:34.038: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 09:37:34.038 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 09:37:34.047 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 09:37:34.05 < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 09:37:34.053 (16ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:37:34.053 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:37:34.053 (0s) > Enter [It] should provide pod UID as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:268 @ 03/24/23 09:37:34.053 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 09:37:34.054 E0324 09:37:34.182629 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:37:35.183428 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:37:36.183855 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:37:37.184167 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 09:37:38.07 Mar 24 09:37:38.073: INFO: Trying to get logs from node kind-worker2 pod downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3 container dapi-container: <nil> Mar 24 09:37:38.075: INFO: Failed to get logs from node "kind-worker2" pod "downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3" container "dapi-container". Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-8278/pods/downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3/log?container=dapi-container&previous=false": stream error: stream ID 1863; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 09:37:38.075 Mar 24 09:37:38.084: INFO: Unexpected error: <*fmt.wrapError | 0xc004760500>: failed to get logs from downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-8278/pods/downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3/log?container=dapi-container&previous=false": stream error: stream ID 1863; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3 for dapi-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/downward-api-8278/pods/downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3/log?container=dapi-container&previous=false\": stream error: stream ID 1863; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc003c81650>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/downward-api-8278/pods/downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1863, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-8278/pods/downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3/log?container=dapi-container&previous=false": stream error: stream ID 1863; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:37:38.084 < Exit [It] should provide pod UID as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:268 @ 03/24/23 09:37:38.084 (4.03s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:37:38.084 Mar 24 09:37:38.084: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:37:38.087 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:37:38.087 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:37:38.087 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 09:37:38.087 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:37:38.087 STEP: Collecting events from namespace "downward-api-8278". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 09:37:38.087 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 09:37:38.089 Mar 24 09:37:38.089: INFO: At 2023-03-24 09:37:34 +0000 UTC - event for downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3: {default-scheduler } Scheduled: Successfully assigned downward-api-8278/downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3 to kind-worker2 Mar 24 09:37:38.089: INFO: At 2023-03-24 09:37:34 +0000 UTC - event for downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 09:37:38.089: INFO: At 2023-03-24 09:37:34 +0000 UTC - event for downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3: {kubelet kind-worker2} Created: Created container dapi-container Mar 24 09:37:38.089: INFO: At 2023-03-24 09:37:34 +0000 UTC - event for downward-api-a521d9f0-11ad-4489-90b5-e6d778c08aa3: {kubelet kind-worker2} Started: Started container dapi-container Mar 24 09:37:38.091: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 09:37:38.091: INFO: Mar 24 09:37:38.094: INFO: Logging node info for node kind-control-plane Mar 24 09:37:38.096: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 27721 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 09:35:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:35:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:35:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:35:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:35:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:37:38.097: INFO: Logging kubelet events for node kind-control-plane Mar 24 09:37:38.099: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 09:37:38.116: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.116: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:37:38.116: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.116: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 09:37:38.116: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.116: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 09:37:38.116: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.116: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 09:37:38.116: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.116: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 09:37:38.116: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.116: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:37:38.116: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.116: INFO: Container etcd ready: true, restart count 0 Mar 24 09:37:38.151: INFO: Latency metrics for node kind-control-plane Mar 24 09:37:38.151: INFO: Logging node info for node kind-worker Mar 24 09:37:38.154: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 27813 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-24 09:36:30 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:36:30 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:36:30 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:36:30 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:36:30 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:37:38.155: INFO: Logging kubelet events for node kind-worker Mar 24 09:37:38.158: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 09:37:38.172: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.172: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:37:38.172: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.172: INFO: Container coredns ready: true, restart count 0 Mar 24 09:37:38.172: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.172: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:37:38.172: INFO: busybox-readonly-false-3e1cd94a-d003-4080-9e8b-26cbcca4a6be started at 2023-03-24 09:37:29 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.172: INFO: Container busybox-readonly-false-3e1cd94a-d003-4080-9e8b-26cbcca4a6be ready: false, restart count 0 E0324 09:37:38.184513 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 09:37:38.206: INFO: Latency metrics for node kind-worker Mar 24 09:37:38.206: INFO: Logging node info for node kind-worker2 Mar 24 09:37:38.209: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 27586 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-03-24 09:34:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:34:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:34:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:34:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:34:32 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:37:38.209: INFO: Logging kubelet events for node kind-worker2 Mar 24 09:37:38.213: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 09:37:38.227: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.227: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:37:38.227: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.227: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:37:38.227: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:37:38.227: INFO: Container coredns ready: true, restart count 0 Mar 24 09:37:38.262: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:37:38.262 (175ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 09:37:38.262 (175ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 09:37:38.262 STEP: Destroying namespace "downward-api-8278" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 09:37:38.262 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 09:37:38.266 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:37:38.266 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:37:38.266 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\spod\sname\,\snamespace\sand\sIP\saddress\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-61/pods/downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70/log?container=dapi-container&previous=false": stream error: stream ID 4545; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:01:50.641from junit_01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 09:01:46.589 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 09:01:46.589 Mar 24 09:01:46.589: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 09:01:46.59 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 09:01:46.601 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 09:01:46.604 < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 09:01:46.608 (19ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:01:46.608 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 09:01:46.608 (0s) > Enter [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:45 @ 03/24/23 09:01:46.608 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 09:01:46.608 E0324 09:01:47.146544 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:01:48.147390 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:01:49.148137 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 09:01:50.148537 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 09:01:50.627 Mar 24 09:01:50.630: INFO: Trying to get logs from node kind-worker2 pod downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70 container dapi-container: <nil> Mar 24 09:01:50.631: INFO: Failed to get logs from node "kind-worker2" pod "downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70" container "dapi-container". Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-61/pods/downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70/log?container=dapi-container&previous=false": stream error: stream ID 4545; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 09:01:50.631 Mar 24 09:01:50.641: INFO: Unexpected error: <*fmt.wrapError | 0xc00403e7e0>: failed to get logs from downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-61/pods/downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70/log?container=dapi-container&previous=false": stream error: stream ID 4545; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70 for dapi-container: Get \"https://127.0.0.1:39221/api/v1/namespaces/downward-api-61/pods/downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70/log?container=dapi-container&previous=false\": stream error: stream ID 4545; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00403b290>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/downward-api-61/pods/downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 4545, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70 for dapi-container: Get "https://127.0.0.1:39221/api/v1/namespaces/downward-api-61/pods/downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70/log?container=dapi-container&previous=false": stream error: stream ID 4545; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 09:01:50.641 < Exit [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:45 @ 03/24/23 09:01:50.641 (4.034s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:01:50.641 Mar 24 09:01:50.641: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 09:01:50.645 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:01:50.645 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 09:01:50.645 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 09:01:50.645 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:01:50.645 STEP: Collecting events from namespace "downward-api-61". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 09:01:50.645 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 09:01:50.649 Mar 24 09:01:50.649: INFO: At 2023-03-24 09:01:46 +0000 UTC - event for downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70: {default-scheduler } Scheduled: Successfully assigned downward-api-61/downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70 to kind-worker2 Mar 24 09:01:50.649: INFO: At 2023-03-24 09:01:47 +0000 UTC - event for downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 09:01:50.649: INFO: At 2023-03-24 09:01:47 +0000 UTC - event for downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70: {kubelet kind-worker2} Created: Created container dapi-container Mar 24 09:01:50.649: INFO: At 2023-03-24 09:01:47 +0000 UTC - event for downward-api-235ba2d6-1a43-4493-8ad8-6bfff3707b70: {kubelet kind-worker2} Started: Started container dapi-container Mar 24 09:01:50.651: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 09:01:50.652: INFO: Mar 24 09:01:50.654: INFO: Logging node info for node kind-control-plane Mar 24 09:01:50.657: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 21806 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 08:59:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:59:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:59:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:59:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:59:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:01:50.657: INFO: Logging kubelet events for node kind-control-plane Mar 24 09:01:50.660: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 09:01:50.666: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.666: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:01:50.666: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.666: INFO: Container etcd ready: true, restart count 0 Mar 24 09:01:50.666: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.666: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 09:01:50.666: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.666: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 09:01:50.666: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.666: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 09:01:50.666: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.666: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 09:01:50.666: INFO: kube-proxy-jfn2p started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.666: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:01:50.703: INFO: Latency metrics for node kind-control-plane Mar 24 09:01:50.703: INFO: Logging node info for node kind-worker Mar 24 09:01:50.707: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 22602 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 09:01:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 09:01:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 09:01:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 09:01:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 09:01:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:01:50.707: INFO: Logging kubelet events for node kind-worker Mar 24 09:01:50.710: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 09:01:50.716: INFO: coredns-5d78c9869d-zpfc4 started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.716: INFO: Container coredns ready: true, restart count 0 Mar 24 09:01:50.716: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.716: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:01:50.716: INFO: kube-proxy-2k7j9 started at 2023-03-24 07:43:33 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.716: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:01:50.755: INFO: Latency metrics for node kind-worker Mar 24 09:01:50.755: INFO: Logging node info for node kind-worker2 Mar 24 09:01:50.759: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 21716 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 07:46:38 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 08:58:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 08:58:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 08:58:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 08:58:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 08:58:50 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 09:01:50.759: INFO: Logging kubelet events for node kind-worker2 Mar 24 09:01:50.763: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 09:01:50.768: INFO: kube-proxy-hdd7g started at 2023-03-24 07:43:34 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.768: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 09:01:50.768: INFO: coredns-5d78c9869d-cth6q started at 2023-03-24 08:46:37 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.768: INFO: Container coredns ready: true, restart count 0 Mar 24 09:01:50.768: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 09:01:50.768: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 09:01:50.810: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 09:01:50.81 (166ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 09:01:50.81 (166ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 09:01:50.81 STEP: Destroying namespace "downward-api-61" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 09:01:50.81 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 09:01:50.816 (6ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:01:50.816 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 09:01:50.816 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sEphemeral\sContainers\s\[NodeConformance\]\swill\sstart\san\sephemeral\scontainer\sin\san\sexisting\spod\s\[Conformance\]$'
[FAILED] Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-2465(e465931c-f878-41b2-8e6e-a7565364b22f)" ephemeral container "debugger": Get "https://127.0.0.1:39221/api/v1/namespaces/ephemeral-containers-test-2465/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 5099; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/ephemeral_containers.go:81 @ 03/24/23 10:35:49.404from junit_01.xml
> Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 10:35:45.28 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:35:45.28 Mar 24 10:35:45.280: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename ephemeral-containers-test - test/e2e/framework/framework.go:250 @ 03/24/23 10:35:45.281 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:35:45.288 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:35:45.291 < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 10:35:45.294 (14ms) > Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:35:45.294 < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:35:45.294 (0s) > Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/common/node/ephemeral_containers.go:39 @ 03/24/23 10:35:45.294 < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/common/node/ephemeral_containers.go:39 @ 03/24/23 10:35:45.294 (0s) > Enter [It] will start an ephemeral container in an existing pod [Conformance] - test/e2e/common/node/ephemeral_containers.go:46 @ 03/24/23 10:35:45.294 STEP: creating a target pod - test/e2e/common/node/ephemeral_containers.go:47 @ 03/24/23 10:35:45.294 E0324 10:35:45.771967 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:35:46.772179 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: adding an ephemeral container - test/e2e/common/node/ephemeral_containers.go:62 @ 03/24/23 10:35:47.308 E0324 10:35:47.772541 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:35:48.772795 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: checking pod container endpoints - test/e2e/common/node/ephemeral_containers.go:76 @ 03/24/23 10:35:49.328 Mar 24 10:35:49.328: INFO: ExecWithOptions {Command:[/bin/echo marco] Namespace:ephemeral-containers-test-2465 PodName:ephemeral-containers-target-pod ContainerName:debugger Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Mar 24 10:35:49.328: INFO: >>> kubeConfig: /root/.kube/kind-test-config Mar 24 10:35:49.328: INFO: ExecWithOptions: Clientset creation Mar 24 10:35:49.328: INFO: ExecWithOptions: execute(POST https://127.0.0.1:39221/api/v1/namespaces/ephemeral-containers-test-2465/pods/ephemeral-containers-target-pod/exec?command=%2Fbin%2Fecho&command=marco&container=debugger&container=debugger&stderr=true&stdout=true) Mar 24 10:35:49.402: INFO: Exec stderr: "" Mar 24 10:35:49.404: INFO: Unexpected error: Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-2465(e465931c-f878-41b2-8e6e-a7565364b22f)" ephemeral container "debugger": <*url.Error | 0xc0066fa450>: Get "https://127.0.0.1:39221/api/v1/namespaces/ephemeral-containers-test-2465/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 5099; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/ephemeral-containers-test-2465/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false", Err: <http2.StreamError>{ StreamID: 5099, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } [FAILED] Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-2465(e465931c-f878-41b2-8e6e-a7565364b22f)" ephemeral container "debugger": Get "https://127.0.0.1:39221/api/v1/namespaces/ephemeral-containers-test-2465/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 5099; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/ephemeral_containers.go:81 @ 03/24/23 10:35:49.404 < Exit [It] will start an ephemeral container in an existing pod [Conformance] - test/e2e/common/node/ephemeral_containers.go:46 @ 03/24/23 10:35:49.404 (4.11s) > Enter [AfterEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:35:49.404 Mar 24 10:35:49.404: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:35:49.407 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:35:49.407 < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:35:49.407 (0s) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 10:35:49.407 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:35:49.407 STEP: Collecting events from namespace "ephemeral-containers-test-2465". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:35:49.408 STEP: Found 7 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:35:49.41 Mar 24 10:35:49.410: INFO: At 2023-03-24 10:35:45 +0000 UTC - event for ephemeral-containers-target-pod: {default-scheduler } Scheduled: Successfully assigned ephemeral-containers-test-2465/ephemeral-containers-target-pod to kind-worker2 Mar 24 10:35:49.410: INFO: At 2023-03-24 10:35:45 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:35:49.410: INFO: At 2023-03-24 10:35:45 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet kind-worker2} Created: Created container test-container-1 Mar 24 10:35:49.410: INFO: At 2023-03-24 10:35:45 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet kind-worker2} Started: Started container test-container-1 Mar 24 10:35:49.410: INFO: At 2023-03-24 10:35:47 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:35:49.410: INFO: At 2023-03-24 10:35:47 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet kind-worker2} Created: Created container debugger Mar 24 10:35:49.410: INFO: At 2023-03-24 10:35:47 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet kind-worker2} Started: Started container debugger Mar 24 10:35:49.412: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:35:49.412: INFO: ephemeral-containers-target-pod kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:45 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:46 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:46 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:45 +0000 UTC }] Mar 24 10:35:49.412: INFO: Mar 24 10:35:49.414: INFO: Unable to fetch ephemeral-containers-test-2465/ephemeral-containers-target-pod/test-container-1 logs: Get "https://127.0.0.1:39221/api/v1/namespaces/ephemeral-containers-test-2465/pods/ephemeral-containers-target-pod/log?container=test-container-1&previous=false&tailLines=42": stream error: stream ID 5107; INTERNAL_ERROR; received from peer Mar 24 10:35:49.416: INFO: Logging node info for node kind-control-plane Mar 24 10:35:49.418: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 45376 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:31:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:35:49.418: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:35:49.422: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:35:49.428: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.428: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:35:49.428: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.428: INFO: Container etcd ready: true, restart count 0 Mar 24 10:35:49.428: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.428: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:35:49.428: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.428: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:35:49.428: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.428: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:35:49.428: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.428: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:35:49.428: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.428: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:35:49.462: INFO: Latency metrics for node kind-control-plane Mar 24 10:35:49.462: INFO: Logging node info for node kind-worker Mar 24 10:35:49.464: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 45921 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:34:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:35:49.465: INFO: Logging kubelet events for node kind-worker Mar 24 10:35:49.468: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 10:35:49.473: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.473: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:35:49.473: INFO: coredns-5d78c9869d-g8gjd started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.473: INFO: Container coredns ready: true, restart count 0 Mar 24 10:35:49.473: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.473: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:35:49.513: INFO: Latency metrics for node kind-worker Mar 24 10:35:49.513: INFO: Logging node info for node kind-worker2 Mar 24 10:35:49.516: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 45833 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:34:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:35:49.516: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:35:49.520: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:35:49.525: INFO: ephemeral-containers-target-pod started at 2023-03-24 10:35:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.525: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 10:35:49.525: INFO: coredns-5d78c9869d-q87g7 started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.525: INFO: Container coredns ready: true, restart count 0 Mar 24 10:35:49.525: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.525: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:35:49.525: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.525: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:35:49.525: INFO: agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634 started at 2023-03-24 10:35:41 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:49.525: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 10:35:49.558: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:35:49.558 (150ms) < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 10:35:49.558 (150ms) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 10:35:49.558 STEP: Destroying namespace "ephemeral-containers-test-2465" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:35:49.558 < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 10:35:49.562 (5ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:35:49.563 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:35:49.563 (0s)
Find ephemeral-containers-target-pod_ephemeral-containers-test-2465(e465931c-f878-41b2-8e6e-a7565364b22f) mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\sa\sbusybox\scommand\sin\sa\spod\sshould\sprint\sthe\soutput\sto\slogs\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 60.001s. Expected <string>: to equal <string>: Hello World\n In [It] at: test/e2e/common/node/kubelet.go:79 @ 03/24/23 10:15:05.146from junit_01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 10:14:03.112 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:14:03.112 Mar 24 10:14:03.112: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 10:14:03.113 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:14:03.126 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:14:03.129 < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 10:14:03.131 (19ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:14:03.131 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:14:03.131 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 10:14:03.131 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 10:14:03.131 (0s) > Enter [It] should print the output to logs [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:52 @ 03/24/23 10:14:03.131 E0324 10:14:03.187137 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:04.187688 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:05.187994 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:06.188301 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:07.188523 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:08.188946 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:09.189206 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:10.189375 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:11.190289 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:12.190518 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:13.191153 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:14.191391 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:15.191856 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:16.192517 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:17.193187 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:18.194095 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:19.194441 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:20.194923 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:21.195545 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:22.196467 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:23.196989 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:24.197225 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:25.197424 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:26.197865 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:27.198907 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:28.199233 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:29.199739 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:30.199968 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:31.200205 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:32.200422 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:33.201258 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:34.201577 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:35.201837 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:36.202121 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:37.202610 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:38.203025 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:39.203243 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:40.204240 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:41.204851 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:42.205085 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:43.205710 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:44.205824 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:45.206266 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:46.206466 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:47.206788 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:48.207066 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:49.207444 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:50.207749 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:51.208799 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:52.209036 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:53.209751 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:54.209811 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:55.210442 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:56.210666 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:57.211062 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:58.211426 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:14:59.211641 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:00.211828 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:01.212346 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:02.212623 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:03.213173 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:04.213554 71312 retrywatcher.go:130] "Watch failed" err="context canceled" [FAILED] Timed out after 60.001s. Expected <string>: to equal <string>: Hello World\n In [It] at: test/e2e/common/node/kubelet.go:79 @ 03/24/23 10:15:05.146 < Exit [It] should print the output to logs [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:52 @ 03/24/23 10:15:05.146 (1m2.014s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:15:05.146 Mar 24 10:15:05.146: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:15:05.149 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:15:05.149 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:15:05.149 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 10:15:05.149 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:15:05.149 STEP: Collecting events from namespace "kubelet-test-313". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:15:05.149 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:15:05.152 Mar 24 10:15:05.152: INFO: At 2023-03-24 10:14:03 +0000 UTC - event for busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1: {default-scheduler } Scheduled: Successfully assigned kubelet-test-313/busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 to kind-worker2 Mar 24 10:15:05.152: INFO: At 2023-03-24 10:14:03 +0000 UTC - event for busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:15:05.152: INFO: At 2023-03-24 10:14:03 +0000 UTC - event for busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1: {kubelet kind-worker2} Created: Created container busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 Mar 24 10:15:05.152: INFO: At 2023-03-24 10:14:03 +0000 UTC - event for busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1: {kubelet kind-worker2} Started: Started container busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 Mar 24 10:15:05.154: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:15:05.154: INFO: busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:14:03 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:14:04 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:14:04 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:14:03 +0000 UTC }] Mar 24 10:15:05.154: INFO: Mar 24 10:15:05.156: INFO: Unable to fetch kubelet-test-313/busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1/busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 logs: Get "https://127.0.0.1:39221/api/v1/namespaces/kubelet-test-313/pods/busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1/log?container=busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1&previous=false&tailLines=42": stream error: stream ID 885; INTERNAL_ERROR; received from peer Mar 24 10:15:05.159: INFO: Logging node info for node kind-control-plane Mar 24 10:15:05.161: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 40966 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:11:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:15:05.161: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:15:05.165: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:15:05.170: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.170: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:15:05.170: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.170: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:15:05.170: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.170: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:15:05.170: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.170: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:15:05.170: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.170: INFO: Container etcd ready: true, restart count 0 Mar 24 10:15:05.170: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.170: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:15:05.170: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.170: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:15:05.205: INFO: Latency metrics for node kind-control-plane Mar 24 10:15:05.205: INFO: Logging node info for node kind-worker Mar 24 10:15:05.207: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 41788 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:14:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:15:05.207: INFO: Logging kubelet events for node kind-worker Mar 24 10:15:05.211: INFO: Logging pods the kubelet thinks is on node kind-worker E0324 10:15:05.214524 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 10:15:05.216: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.216: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:15:05.216: INFO: coredns-5d78c9869d-g8gjd started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.216: INFO: Container coredns ready: true, restart count 0 Mar 24 10:15:05.216: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.216: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:15:05.216: INFO: webserver-pod started at 2023-03-24 10:12:17 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.216: INFO: Container agnhost ready: false, restart count 0 Mar 24 10:15:05.248: INFO: Latency metrics for node kind-worker Mar 24 10:15:05.248: INFO: Logging node info for node kind-worker2 Mar 24 10:15:05.250: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 41568 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:13:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:15:05.251: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:15:05.254: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:15:05.259: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.259: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:15:05.259: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.259: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:15:05.259: INFO: coredns-5d78c9869d-q87g7 started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.259: INFO: Container coredns ready: true, restart count 0 Mar 24 10:15:05.259: INFO: busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 started at 2023-03-24 10:14:03 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:05.259: INFO: Container busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 ready: true, restart count 0 Mar 24 10:15:05.291: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:15:05.291 (142ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 10:15:05.291 (142ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 10:15:05.291 STEP: Destroying namespace "kubelet-test-313" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:15:05.291 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 10:15:05.295 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:15:05.295 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:15:05.295 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\sa\sread\sonly\sbusybox\scontainer\sshould\snot\swrite\sto\sroot\sfilesystem\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 60.000s. Expected <string>: to equal <string>: /bin/sh: can't create /file: Read-only file system\n In [It] at: test/e2e/common/node/kubelet.go:214 @ 03/24/23 10:27:10.13from junit_01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 10:26:08.099 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:26:08.099 Mar 24 10:26:08.099: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 10:26:08.1 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:26:08.109 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:26:08.112 < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 10:26:08.115 (16ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:26:08.115 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:26:08.115 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 10:26:08.115 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 10:26:08.115 (0s) > Enter [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:184 @ 03/24/23 10:26:08.115 E0324 10:26:08.503134 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:09.503371 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:10.503606 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:11.503858 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:12.504116 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:13.504956 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:14.505076 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:15.505391 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:16.505730 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:17.505971 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:18.506261 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:19.506535 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:20.506800 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:21.507027 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:22.507143 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:23.507834 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:24.508192 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:25.508422 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:26.508849 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:27.509180 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:28.509555 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:29.509808 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:30.510892 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:31.511179 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:32.512129 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:33.512774 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:34.513273 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:35.513512 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:36.513747 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:37.514018 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:38.514258 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:39.514885 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:40.515123 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:41.515255 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:42.515997 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:43.516751 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:44.517402 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:45.517551 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:46.517811 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:47.518041 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:48.518379 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:49.518513 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:50.518872 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:51.519010 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:52.519228 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:53.519321 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:54.519843 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:55.520509 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:56.520639 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:57.521487 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:58.522078 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:26:59.522972 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:00.523194 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:01.523449 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:02.523605 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:03.524316 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:04.524635 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:05.525063 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:06.525133 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:07.525393 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:08.525781 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:27:09.526147 71312 retrywatcher.go:130] "Watch failed" err="context canceled" [FAILED] Timed out after 60.000s. Expected <string>: to equal <string>: /bin/sh: can't create /file: Read-only file system\n In [It] at: test/e2e/common/node/kubelet.go:214 @ 03/24/23 10:27:10.13 < Exit [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:184 @ 03/24/23 10:27:10.13 (1m2.015s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:27:10.13 Mar 24 10:27:10.130: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:27:10.133 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:27:10.133 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:27:10.133 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 10:27:10.133 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:27:10.133 STEP: Collecting events from namespace "kubelet-test-4992". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:27:10.133 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:27:10.136 Mar 24 10:27:10.136: INFO: At 2023-03-24 10:26:08 +0000 UTC - event for busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499: {default-scheduler } Scheduled: Successfully assigned kubelet-test-4992/busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499 to kind-worker2 Mar 24 10:27:10.136: INFO: At 2023-03-24 10:26:08 +0000 UTC - event for busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:27:10.136: INFO: At 2023-03-24 10:26:08 +0000 UTC - event for busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499: {kubelet kind-worker2} Created: Created container busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499 Mar 24 10:27:10.136: INFO: At 2023-03-24 10:26:08 +0000 UTC - event for busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499: {kubelet kind-worker2} Started: Started container busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499 Mar 24 10:27:10.138: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:27:10.138: INFO: busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499 kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:26:08 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:26:08 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:26:08 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:26:08 +0000 UTC }] Mar 24 10:27:10.138: INFO: Mar 24 10:27:10.140: INFO: Unable to fetch kubelet-test-4992/busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499/busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499 logs: Get "https://127.0.0.1:39221/api/v1/namespaces/kubelet-test-4992/pods/busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499/log?container=busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499&previous=false&tailLines=42": stream error: stream ID 2831; INTERNAL_ERROR; received from peer Mar 24 10:27:10.142: INFO: Logging node info for node kind-control-plane Mar 24 10:27:10.145: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 43986 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:26:34 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:26:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:26:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:26:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:26:34 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:27:10.145: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:27:10.149: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:27:10.154: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.154: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:27:10.154: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.154: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:27:10.154: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.154: INFO: Container etcd ready: true, restart count 0 Mar 24 10:27:10.154: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.154: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:27:10.154: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.154: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:27:10.154: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.154: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:27:10.154: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.154: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:27:10.191: INFO: Latency metrics for node kind-control-plane Mar 24 10:27:10.191: INFO: Logging node info for node kind-worker Mar 24 10:27:10.194: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 43267 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:24:16 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:24:16 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:24:16 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:24:16 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:24:16 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:27:10.194: INFO: Logging kubelet events for node kind-worker Mar 24 10:27:10.197: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 10:27:10.202: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.202: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:27:10.202: INFO: coredns-5d78c9869d-g8gjd started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.202: INFO: Container coredns ready: true, restart count 0 Mar 24 10:27:10.202: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.202: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:27:10.236: INFO: Latency metrics for node kind-worker Mar 24 10:27:10.236: INFO: Logging node info for node kind-worker2 Mar 24 10:27:10.238: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 43107 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:23:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:23:56 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:23:56 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:23:56 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:23:56 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:27:10.239: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:27:10.242: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:27:10.247: INFO: busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499 started at 2023-03-24 10:26:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.247: INFO: Container busybox-readonly-fsb0faacda-63b1-46e7-84cd-33ee67f4c499 ready: true, restart count 0 Mar 24 10:27:10.247: INFO: coredns-5d78c9869d-q87g7 started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.247: INFO: Container coredns ready: true, restart count 0 Mar 24 10:27:10.247: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.247: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:27:10.247: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:27:10.247: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:27:10.277: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:27:10.277 (144ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 10:27:10.277 (144ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 10:27:10.277 STEP: Destroying namespace "kubelet-test-4992" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:27:10.277 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 10:27:10.281 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:27:10.281 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:27:10.281 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\san\sagnhost\sPod\swith\shostAliases\sshould\swrite\sentries\sto\s\/etc\/hosts\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/kubelet-test-4411/pods/agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634/log": stream error: stream ID 5021; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/kubelet.go:165 @ 03/24/23 10:35:45.141from junit_01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 10:35:41.108 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:35:41.108 Mar 24 10:35:41.108: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 10:35:41.109 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:35:41.118 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:35:41.121 < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 10:35:41.124 (16ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:35:41.124 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:35:41.124 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 10:35:41.124 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 10:35:41.124 (0s) > Enter [It] should write entries to /etc/hosts [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:148 @ 03/24/23 10:35:41.124 STEP: Waiting for pod completion - test/e2e/common/node/kubelet.go:160 @ 03/24/23 10:35:41.129 E0324 10:35:41.769935 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:35:42.770602 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:35:43.771644 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:35:44.771883 71312 retrywatcher.go:130] "Watch failed" err="context canceled" Mar 24 10:35:45.141: INFO: Unexpected error: <*url.Error | 0xc0069d4e70>: Get "https://127.0.0.1:39221/api/v1/namespaces/kubelet-test-4411/pods/agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634/log": stream error: stream ID 5021; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/kubelet-test-4411/pods/agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634/log", Err: <http2.StreamError>{ StreamID: 5021, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:39221/api/v1/namespaces/kubelet-test-4411/pods/agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634/log": stream error: stream ID 5021; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/kubelet.go:165 @ 03/24/23 10:35:45.141 < Exit [It] should write entries to /etc/hosts [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:148 @ 03/24/23 10:35:45.141 (4.017s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:35:45.141 Mar 24 10:35:45.141: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:35:45.144 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:35:45.144 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:35:45.144 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 10:35:45.144 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:35:45.144 STEP: Collecting events from namespace "kubelet-test-4411". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:35:45.144 STEP: Found 4 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:35:45.147 Mar 24 10:35:45.147: INFO: At 2023-03-24 10:35:41 +0000 UTC - event for agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634: {default-scheduler } Scheduled: Successfully assigned kubelet-test-4411/agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634 to kind-worker2 Mar 24 10:35:45.147: INFO: At 2023-03-24 10:35:41 +0000 UTC - event for agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 10:35:45.147: INFO: At 2023-03-24 10:35:41 +0000 UTC - event for agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634: {kubelet kind-worker2} Created: Created container agnhost-container Mar 24 10:35:45.147: INFO: At 2023-03-24 10:35:41 +0000 UTC - event for agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634: {kubelet kind-worker2} Started: Started container agnhost-container Mar 24 10:35:45.149: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:35:45.149: INFO: agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634 kind-worker2 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:41 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:41 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:41 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:35:41 +0000 UTC }] Mar 24 10:35:45.149: INFO: Mar 24 10:35:45.150: INFO: Unable to fetch kubelet-test-4411/agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634/agnhost-container logs: Get "https://127.0.0.1:39221/api/v1/namespaces/kubelet-test-4411/pods/agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 5029; INTERNAL_ERROR; received from peer Mar 24 10:35:45.153: INFO: Logging node info for node kind-control-plane Mar 24 10:35:45.155: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 45376 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:31:40 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:31:40 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:35:45.155: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:35:45.158: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:35:45.163: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.163: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:35:45.163: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.163: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:35:45.163: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.163: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:35:45.163: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.163: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:35:45.163: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.163: INFO: Container etcd ready: true, restart count 0 Mar 24 10:35:45.163: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.163: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:35:45.163: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.163: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:35:45.191: INFO: Latency metrics for node kind-control-plane Mar 24 10:35:45.191: INFO: Logging node info for node kind-worker Mar 24 10:35:45.194: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 45921 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:34:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:34:28 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:35:45.194: INFO: Logging kubelet events for node kind-worker Mar 24 10:35:45.197: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 10:35:45.202: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.202: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:35:45.202: INFO: coredns-5d78c9869d-g8gjd started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.202: INFO: Container coredns ready: true, restart count 0 Mar 24 10:35:45.202: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.202: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:35:45.232: INFO: Latency metrics for node kind-worker Mar 24 10:35:45.232: INFO: Logging node info for node kind-worker2 Mar 24 10:35:45.235: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 45833 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:34:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:34:07 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:35:45.235: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:35:45.238: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:35:45.243: INFO: coredns-5d78c9869d-q87g7 started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.243: INFO: Container coredns ready: true, restart count 0 Mar 24 10:35:45.243: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.243: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:35:45.243: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.243: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:35:45.243: INFO: agnhost-host-aliases3a616af3-1fa4-479f-acd0-7106822ff634 started at 2023-03-24 10:35:41 +0000 UTC (0+1 container statuses recorded) Mar 24 10:35:45.243: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 10:35:45.275: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:35:45.275 (131ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 10:35:45.275 (131ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 10:35:45.275 STEP: Destroying namespace "kubelet-test-4411" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:35:45.275 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 10:35:45.279 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:35:45.279 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:35:45.279 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sPods\sshould\scontain\senvironment\svariables\sfor\sservices\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Container should have service environment variables set Unexpected error: <*fmt.wrapError | 0xc00426a180>: failed to get logs from client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 for env3cont: Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1071; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 for env3cont: Get \"https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false\": stream error: stream ID 1071; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc004cbaba0>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false", Err: <http2.StreamError>{ StreamID: 1071, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } occurred In [It] at: test/e2e/common/node/pods.go:526 @ 03/24/23 10:15:23.618from junit_01.xml
> Enter [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 10:15:09.5 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 10:15:09.5 Mar 24 10:15:09.500: INFO: >>> kubeConfig: /root/.kube/kind-test-config STEP: Building a namespace api object, basename pods - test/e2e/framework/framework.go:250 @ 03/24/23 10:15:09.501 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 03/24/23 10:15:09.509 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:262 @ 03/24/23 10:15:09.512 < Exit [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 10:15:09.515 (15ms) > Enter [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:15:09.515 < Exit [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 10:15:09.515 (0s) > Enter [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 10:15:09.515 < Exit [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 10:15:09.515 (0s) > Enter [It] should contain environment variables for services [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:445 @ 03/24/23 10:15:09.515 E0324 10:15:10.215795 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:11.216737 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:12.216893 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:13.217535 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:14.217795 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:15.218807 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 10:15:15.551 Mar 24 10:15:15.554: INFO: Trying to get logs from node kind-worker2 pod client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 container env3cont: <nil> Mar 24 10:15:15.555: INFO: Failed to get logs from node "kind-worker2" pod "client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824" container "env3cont". Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1039; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 10:15:15.555 Mar 24 10:15:15.564: INFO: (Attempt 1 of 3) Unexpected error occurred: failed to get logs from client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 for env3cont: Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1039; INTERNAL_ERROR; received from peer E0324 10:15:16.219441 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:17.219679 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:18.220153 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:19.220415 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 10:15:19.578 Mar 24 10:15:19.580: INFO: Trying to get logs from node kind-worker pod client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 container env3cont: <nil> Mar 24 10:15:19.582: INFO: Failed to get logs from node "kind-worker" pod "client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824" container "env3cont". Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1055; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 10:15:19.582 Mar 24 10:15:19.592: INFO: (Attempt 2 of 3) Unexpected error occurred: failed to get logs from client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 for env3cont: Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1055; INTERNAL_ERROR; received from peer E0324 10:15:20.220740 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:21.220973 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:22.221115 71312 retrywatcher.go:130] "Watch failed" err="context canceled" E0324 10:15:23.221908 71312 retrywatcher.go:130] "Watch failed" err="context canceled" STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 10:15:23.604 Mar 24 10:15:23.607: INFO: Trying to get logs from node kind-worker2 pod client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 container env3cont: <nil> Mar 24 10:15:23.608: INFO: Failed to get logs from node "kind-worker2" pod "client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824" container "env3cont". Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1071; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 10:15:23.608 Mar 24 10:15:23.618: INFO: (Attempt 3 of 3) Unexpected error occurred: failed to get logs from client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 for env3cont: Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1071; INTERNAL_ERROR; received from peer [FAILED] Container should have service environment variables set Unexpected error: <*fmt.wrapError | 0xc00426a180>: failed to get logs from client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 for env3cont: Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false": stream error: stream ID 1071; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 for env3cont: Get \"https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false\": stream error: stream ID 1071; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc004cbaba0>{ Op: "Get", URL: "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824/log?container=env3cont&previous=false", Err: <http2.StreamError>{ StreamID: 1071, Code: 2, Cause: <*errors.errorString | 0xc00022d650>{ s: "received from peer", }, }, }, } occurred In [It] at: test/e2e/common/node/pods.go:526 @ 03/24/23 10:15:23.618 < Exit [It] should contain environment variables for services [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:445 @ 03/24/23 10:15:23.618 (14.103s) > Enter [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:15:23.618 Mar 24 10:15:23.618: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 10:15:23.621 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:15:23.621 < Exit [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 10:15:23.621 (0s) > Enter [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 10:15:23.622 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:15:23.622 STEP: Collecting events from namespace "pods-5130". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 10:15:23.622 STEP: Found 16 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 10:15:23.624 Mar 24 10:15:23.624: INFO: At 2023-03-24 10:15:09 +0000 UTC - event for server-envvars-a6215e27-6986-4246-94d4-8038d3217812: {default-scheduler } Scheduled: Successfully assigned pods-5130/server-envvars-a6215e27-6986-4246-94d4-8038d3217812 to kind-worker2 Mar 24 10:15:23.624: INFO: At 2023-03-24 10:15:09 +0000 UTC - event for server-envvars-a6215e27-6986-4246-94d4-8038d3217812: {kubelet kind-worker2} Created: Created container srv Mar 24 10:15:23.624: INFO: At 2023-03-24 10:15:09 +0000 UTC - event for server-envvars-a6215e27-6986-4246-94d4-8038d3217812: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 10:15:23.624: INFO: At 2023-03-24 10:15:10 +0000 UTC - event for server-envvars-a6215e27-6986-4246-94d4-8038d3217812: {kubelet kind-worker2} Started: Started container srv Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:11 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:11 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {default-scheduler } Scheduled: Successfully assigned pods-5130/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 to kind-worker2 Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:12 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker2} Created: Created container env3cont Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:12 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker2} Started: Started container env3cont Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:15 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {default-scheduler } Scheduled: Successfully assigned pods-5130/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 to kind-worker Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:16 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker} Started: Started container env3cont Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:16 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker} Created: Created container env3cont Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:16 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:19 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {default-scheduler } Scheduled: Successfully assigned pods-5130/client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824 to kind-worker2 Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:20 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker2} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:20 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker2} Created: Created container env3cont Mar 24 10:15:23.625: INFO: At 2023-03-24 10:15:20 +0000 UTC - event for client-envvars-a7a16b32-cc94-4697-9f5b-f6ffdc29b824: {kubelet kind-worker2} Started: Started container env3cont Mar 24 10:15:23.627: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 10:15:23.627: INFO: server-envvars-a6215e27-6986-4246-94d4-8038d3217812 kind-worker2 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:15:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:15:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:15:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 10:15:09 +0000 UTC }] Mar 24 10:15:23.627: INFO: Mar 24 10:15:23.629: INFO: Unable to fetch pods-5130/server-envvars-a6215e27-6986-4246-94d4-8038d3217812/srv logs: Get "https://127.0.0.1:39221/api/v1/namespaces/pods-5130/pods/server-envvars-a6215e27-6986-4246-94d4-8038d3217812/log?container=srv&previous=false&tailLines=42": stream error: stream ID 1083; INTERNAL_ERROR; received from peer Mar 24 10:15:23.631: INFO: Logging node info for node kind-control-plane Mar 24 10:15:23.633: INFO: Node Info: &Node{ObjectMeta:{kind-control-plane ed6e9fcf-a11c-4487-a8e1-3b52f58a7711 40966 0 2023-03-24 07:43:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-control-plane kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers:] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 07:43:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kubeadm Update v1 2023-03-24 07:43:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}},"f:labels":{"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-24 07:43:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-03-24 10:11:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.244.0.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-control-plane,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.244.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:11:17 +0000 UTC,LastTransitionTime:2023-03-24 07:43:25 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.3,},NodeAddress{Type:Hostname,Address:kind-control-plane,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f3f653f2e5b24e1e9c5a60fc12ac9d20,SystemUUID:d656d7ef-7657-48c3-8b15-a23a7fcde7d5,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:15:23.633: INFO: Logging kubelet events for node kind-control-plane Mar 24 10:15:23.637: INFO: Logging pods the kubelet thinks is on node kind-control-plane Mar 24 10:15:23.643: INFO: etcd-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.643: INFO: Container etcd ready: true, restart count 0 Mar 24 10:15:23.643: INFO: kube-apiserver-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.643: INFO: Container kube-apiserver ready: true, restart count 0 Mar 24 10:15:23.643: INFO: kube-scheduler-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.643: INFO: Container kube-scheduler ready: true, restart count 0 Mar 24 10:15:23.643: INFO: kindnet-stxh8 started at 2023-03-24 07:43:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.643: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:15:23.643: INFO: kube-proxy-plrm6 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.643: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:15:23.643: INFO: kube-controller-manager-kind-control-plane started at 2023-03-24 07:43:08 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.643: INFO: Container kube-controller-manager ready: true, restart count 0 Mar 24 10:15:23.643: INFO: local-path-provisioner-687869657c-ptm2r started at 2023-03-24 07:43:25 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.643: INFO: Container local-path-provisioner ready: true, restart count 0 Mar 24 10:15:23.672: INFO: Latency metrics for node kind-control-plane Mar 24 10:15:23.672: INFO: Logging node info for node kind-worker Mar 24 10:15:23.675: INFO: Node Info: &Node{ObjectMeta:{kind-worker c7e530d5-accf-4476-9a3d-40b2c67b71c2 41788 0 2023-03-24 07:43:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubeadm Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-03-24 07:43:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.1.0/24\"":{}}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:example.com/fakecpu":{},"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:14:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.1.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},example.com/fakecpu: {{1 3} {<nil>} 1k DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:14:04 +0000 UTC,LastTransitionTime:2023-03-24 07:43:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.2,},NodeAddress{Type:Hostname,Address:kind-worker,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:8d1af9dfd5ff4655a00be225c4354ef6,SystemUUID:d4d7a675-6926-4128-ae40-720e185fa1d3,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:13ac9b3c476d7290a4451d65d09d6016a2cb89836ffbfa4eae55b72731a22080 registry.k8s.io/build-image/distroless-iptables:v0.2.2],SizeBytes:7729580,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:15:23.675: INFO: Logging kubelet events for node kind-worker Mar 24 10:15:23.678: INFO: Logging pods the kubelet thinks is on node kind-worker Mar 24 10:15:23.683: INFO: kindnet-ssfqs started at 2023-03-24 07:43:29 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.683: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:15:23.683: INFO: coredns-5d78c9869d-g8gjd started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.683: INFO: Container coredns ready: true, restart count 0 Mar 24 10:15:23.683: INFO: kube-proxy-shmq4 started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.683: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:15:23.683: INFO: webserver-pod started at 2023-03-24 10:12:17 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.683: INFO: Container agnhost ready: false, restart count 0 Mar 24 10:15:23.712: INFO: Latency metrics for node kind-worker Mar 24 10:15:23.712: INFO: Logging node info for node kind-worker2 Mar 24 10:15:23.714: INFO: Node Info: &Node{ObjectMeta:{kind-worker2 4d173215-5dca-4e7d-88e8-00d9da6fc502 41568 0 2023-03-24 07:43:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:kind-worker2 kubernetes.io/os:linux] map[kubeadm.alpha.kubernetes.io/cri-socket:unix:///run/containerd/containerd.sock node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.244.2.0/24\"":{}}}} } {kubeadm Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:kubeadm.alpha.kubernetes.io/cri-socket":{}}}} } {kubelet Update v1 2023-03-24 07:43:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}},"f:spec":{"f:providerID":{}}} } {e2e.test Update v1 2023-03-24 10:11:58 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:scheduling.k8s.io/foo":{}},"f:capacity":{"f:scheduling.k8s.io/foo":{}}}} status} {kubelet Update v1 2023-03-24 10:13:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.244.2.0/24,DoNotUseExternalID:,ProviderID:kind://docker/kind/kind-worker2,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.244.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Allocatable:ResourceList{cpu: {{8 0} {<nil>} 8 DecimalSI},ephemeral-storage: {{791251738624 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{54757810176 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},scheduling.k8s.io/foo: {{5 0} {<nil>} 5 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 10:13:45 +0000 UTC,LastTransitionTime:2023-03-24 07:43:33 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.18.0.4,},NodeAddress{Type:Hostname,Address:kind-worker2,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:55d280fb7d7e4bb38ad5ebc246a29483,SystemUUID:1789092d-f2cf-4830-b44d-a758299e4357,BootID:3f40f191-1f55-4e4b-baca-a4c5b1e9c70f,KernelVersion:5.4.0-1086-gke,OSImage:Ubuntu 22.04.2 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:1eb068d82e1a7c56bd487fff110415b6154ab7aaf6392f87bcc4e0c8443a1318 registry.k8s.io/kube-apiserver:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:118987882,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:baab896f219a49fcd92c58df9233cc224e83640edc833fefa2e01c82b4bd7e9a registry.k8s.io/kube-controller-manager:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:110848772,},ContainerImage{Names:[registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:a8e1ad87f31a8139c68a61ece5033a97a2e3f46b13717d1d5c7000730dcb6b6a registry.k8s.io/kube-proxy:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:72680802,},ContainerImage{Names:[docker.io/library/import-2023-03-24@sha256:9b49a20d99958e3eca0c4d32beb7a36582e50c0583259aa808992d41354294a2 registry.k8s.io/kube-scheduler:v1.28.0-alpha.0.1_f33498a8256b45],SizeBytes:56740597,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[docker.io/kindest/kindnetd:v20230227-15197099],SizeBytes:26506530,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[docker.io/kindest/local-path-provisioner:v0.0.22-kind.0],SizeBytes:17660818,},ContainerImage{Names:[registry.k8s.io/coredns/coredns:v1.10.1],SizeBytes:16190758,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[docker.io/kindest/local-path-helper:v20230227-8863bcd1],SizeBytes:2898085,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause:3.7],SizeBytes:311278,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 10:15:23.715: INFO: Logging kubelet events for node kind-worker2 Mar 24 10:15:23.718: INFO: Logging pods the kubelet thinks is on node kind-worker2 Mar 24 10:15:23.723: INFO: kindnet-mhhtq started at 2023-03-24 07:43:30 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.723: INFO: Container kindnet-cni ready: true, restart count 0 Mar 24 10:15:23.723: INFO: kube-proxy-862nm started at 2023-03-24 09:58:23 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.723: INFO: Container kube-proxy ready: true, restart count 0 Mar 24 10:15:23.723: INFO: server-envvars-a6215e27-6986-4246-94d4-8038d3217812 started at 2023-03-24 10:15:09 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.723: INFO: Container srv ready: true, restart count 0 Mar 24 10:15:23.723: INFO: coredns-5d78c9869d-q87g7 started at 2023-03-24 10:02:45 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.723: INFO: Container coredns ready: true, restart count 0 Mar 24 10:15:23.723: INFO: busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 started at 2023-03-24 10:14:03 +0000 UTC (0+1 container statuses recorded) Mar 24 10:15:23.723: INFO: Container busybox-scheduling-e02dc6f4-d9ed-446a-aa4a-3e653492f5c1 ready: true, restart count 0 Mar 24 10:15:23.757: INFO: Latency metrics for node kind-worker2 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 10:15:23.757 (135ms) < Exit [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 10:15:23.757 (135ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 10:15:23.757 STEP: Destroying namespace "pods-5130" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 10:15:23.757 < Exit [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 10:15:23.761 (4ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:15:23.761 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 03/24/23 10:15:23.761 (0s)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sPods\sshould\ssupport\sretrieving\slogs\sfrom\sthe\scontainer\sover\swebsockets\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Failed to open websocket to wss://127.0.0.1:39221/api/v1/namespaces/pods-1640/pods/pod-logs-websocket-601df20c-3352-471c-ae87-9f8bcc688932/log?container=main: websocket.Dial wss://127.0.0.1:39221/api/v1/namespaces/pods-1640/pods/pod-logs-websocket-601df20c-3352-471c-ae87-9f8bcc688932/log?container=main: unexpected EOF In [It] at: test/e2e/common/node/pods.go:654 @ 03/24/23 09:49:27.997
> Enter [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 09:49:25.956 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 09