go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sConfigMap\sshould\sbe\sconsumable\svia\senvironment\svariable\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4009/pods/pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a/log?container=env-test&previous=false": stream error: stream ID 169; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:06.78from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:25:02.679 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:02.679 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:02.679 Mar 24 03:25:02.692: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:25:02.692 (13ms) > Enter [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:02.692 < Exit [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:02.692 (0s) > Enter [It] should be consumable via environment variable [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:45 @ 03/24/23 03:25:02.692 STEP: Creating configMap configmap-4009/configmap-test-06545edf-0566-4ede-8bcc-329d6eb5df12 - test/e2e/common/node/configmap.go:48 @ 03/24/23 03:25:02.692 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:25:02.696 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:25:06.731 Mar 24 03:25:06.734: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a container env-test: <nil> Mar 24 03:25:06.752: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a" container "env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4009/pods/pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a/log?container=env-test&previous=false": stream error: stream ID 169; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:25:06.752 Mar 24 03:25:06.780: INFO: Unexpected error: <*fmt.wrapError | 0xc000375d60>: failed to get logs from pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4009/pods/pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a/log?container=env-test&previous=false": stream error: stream ID 169; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a for env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-4009/pods/pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a/log?container=env-test&previous=false\": stream error: stream ID 169; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000fc3170>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-4009/pods/pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 169, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4009/pods/pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a/log?container=env-test&previous=false": stream error: stream ID 169; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:06.78 < Exit [It] should be consumable via environment variable [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:45 @ 03/24/23 03:25:06.78 (4.089s) > Enter [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:06.78 Mar 24 03:25:06.780: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:06.79 (9ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:06.79 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:06.79 (0s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:25:06.79 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:06.79 STEP: Collecting events from namespace "configmap-4009". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:25:06.79 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:25:06.797 Mar 24 03:25:06.797: INFO: At 2023-03-24 03:25:03 +0000 UTC - event for pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:25:06.797: INFO: At 2023-03-24 03:25:03 +0000 UTC - event for pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container env-test Mar 24 03:25:06.797: INFO: At 2023-03-24 03:25:04 +0000 UTC - event for pod-configmaps-9bd3342e-c3dc-4b75-866d-39770b1f9d0a: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container env-test Mar 24 03:25:06.800: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:25:06.800: INFO: Mar 24 03:25:06.801: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:06.812: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:25:06.812: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:06.816: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:06.820: INFO: pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:25:06.820: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:25:06.820: INFO: log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 ready: false, restart count 0 Mar 24 03:25:06.820: INFO: pod-projected-secrets-617e9397-7e47-428d-82c7-934c8dc9f05c started at 2023-03-24 03:25:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container projected-secret-volume-test ready: false, restart count 0 Mar 24 03:25:06.820: INFO: pod51e69781-66dd-4938-9447-45259953fe14 started at 2023-03-24 03:24:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container container33ed3425-ff63-4dac-887a-19a0f9af1c27 ready: false, restart count 0 Mar 24 03:25:06.820: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:25:06.820: INFO: log-pod-d96fc004-0636-46ba-8b56-a0669d739721 started at 2023-03-24 03:25:01 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container logger ready: false, restart count 0 Mar 24 03:25:06.820: INFO: pod59544fef-132c-48a4-9c23-f2fab7a12d65 started at 2023-03-24 03:25:03 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container container5663a1ff-e6c4-4622-bf3e-1e564e4823dd ready: false, restart count 0 Mar 24 03:25:06.820: INFO: downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:06.820: INFO: Container dapi-container ready: true, restart count 0 W0324 03:25:06.821543 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:25:08.880: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:08.88 (2.09s) < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:25:08.88 (2.09s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:25:08.88 STEP: Destroying namespace "configmap-4009" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:25:08.88 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:25:08.887 (7ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sConfigMap\sshould\sbe\sconsumable\svia\sthe\senvironment\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5925/pods/pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45/log?container=env-test&previous=false": stream error: stream ID 1477; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:09.659from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:34:05.623 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:34:05.623 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:34:05.623 Mar 24 03:34:05.626: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:34:05.626 (3ms) > Enter [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:05.626 < Exit [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:05.626 (0s) > Enter [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:93 @ 03/24/23 03:34:05.626 STEP: Creating configMap configmap-5925/configmap-test-1a3b01a4-e853-42f6-aa3b-a93ddd5a3915 - test/e2e/common/node/configmap.go:96 @ 03/24/23 03:34:05.626 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:34:05.628 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:34:09.651 Mar 24 03:34:09.652: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45 container env-test: <nil> Mar 24 03:34:09.654: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45" container "env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5925/pods/pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45/log?container=env-test&previous=false": stream error: stream ID 1477; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:34:09.654 Mar 24 03:34:09.659: INFO: Unexpected error: <*fmt.wrapError | 0xc0011d1220>: failed to get logs from pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5925/pods/pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45/log?container=env-test&previous=false": stream error: stream ID 1477; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45 for env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-5925/pods/pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45/log?container=env-test&previous=false\": stream error: stream ID 1477; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0012e4ff0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-5925/pods/pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 1477, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5925/pods/pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45/log?container=env-test&previous=false": stream error: stream ID 1477; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:09.659 < Exit [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:93 @ 03/24/23 03:34:09.659 (4.033s) > Enter [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:09.659 Mar 24 03:34:09.659: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:09.66 (1ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:09.66 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:09.66 (0s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:34:09.66 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:09.66 STEP: Collecting events from namespace "configmap-5925". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:34:09.66 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:34:09.661 Mar 24 03:34:09.661: INFO: At 2023-03-24 03:34:06 +0000 UTC - event for pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:34:09.661: INFO: At 2023-03-24 03:34:06 +0000 UTC - event for pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container env-test Mar 24 03:34:09.662: INFO: At 2023-03-24 03:34:06 +0000 UTC - event for pod-configmaps-a89885ea-54b9-4abf-88d1-14d0323c2c45: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container env-test Mar 24 03:34:09.662: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:34:09.662: INFO: Mar 24 03:34:09.664: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:09.665: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:34:09.665: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:09.666: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:09.669: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:09.669: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:34:09.669: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:09.669: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:09.669: INFO: pod-handle-http-request started at 2023-03-24 03:33:35 +0000 UTC (0+2 container statuses recorded) Mar 24 03:34:09.669: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:34:09.669: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:34:09.669: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:09.669: INFO: Container test ready: true, restart count 0 Mar 24 03:34:09.669: INFO: terminate-cmd-rpof8e86efaf-7dcf-4ac9-9000-02db360830da started at 2023-03-24 03:34:06 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:09.669: INFO: Container terminate-cmd-rpof ready: false, restart count 1 Mar 24 03:34:09.669: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:09.669: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:09.669: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:09.669: INFO: Container agnhost-container ready: true, restart count 0 W0324 03:34:09.670702 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:34:09.718: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:09.718 (58ms) < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:34:09.718 (58ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:34:09.718 STEP: Destroying namespace "configmap-5925" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:34:09.718 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:34:09.72 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc001259070>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 03:38:05.99from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:36:01.92 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:36:01.92 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 03:36:01.92 Mar 24 03:36:01.923: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:36:01.923 (3ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:36:01.923 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:36:01.923 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:36:01.923 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 03:36:01.925 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:36:03.95 (2.026s) > Enter [It] should execute poststart exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:135 @ 03/24/23 03:36:03.95 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 03:36:03.95 STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 03:36:05.99 [FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc001259070>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 03:38:05.99 < Exit [It] should execute poststart exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:135 @ 03/24/23 03:38:05.99 (2m2.041s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:38:05.991 Mar 24 03:38:05.991: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:38:05.992 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:38:05.992 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:38:05.992 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:38:05.992 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:38:05.992 STEP: Collecting events from namespace "container-lifecycle-hook-90". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:38:05.992 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:38:05.994 Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:02 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:02 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:02 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:02 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:02 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:02 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:04 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:04 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container pod-with-poststart-exec-hook Mar 24 03:38:05.994: INFO: At 2023-03-24 03:36:04 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container pod-with-poststart-exec-hook Mar 24 03:38:05.995: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:38:05.995: INFO: pod-handle-http-request tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:01 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:02 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:02 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:01 +0000 UTC }] Mar 24 03:38:05.995: INFO: pod-with-poststart-exec-hook tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:03 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:05 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:05 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:36:03 +0000 UTC }] Mar 24 03:38:05.995: INFO: Mar 24 03:38:05.997: INFO: Unable to fetch container-lifecycle-hook-90/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-90/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 2527; INTERNAL_ERROR; received from peer Mar 24 03:38:05.998: INFO: Unable to fetch container-lifecycle-hook-90/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-90/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 2529; INTERNAL_ERROR; received from peer Mar 24 03:38:06.000: INFO: Unable to fetch container-lifecycle-hook-90/pod-with-poststart-exec-hook/pod-with-poststart-exec-hook logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-90/pods/pod-with-poststart-exec-hook/log?container=pod-with-poststart-exec-hook&previous=false&tailLines=42": stream error: stream ID 2531; INTERNAL_ERROR; received from peer Mar 24 03:38:06.001: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:38:06.002: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 4189 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:35:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:38:06.005: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:38:06.006: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:38:06.011: INFO: busybox-696c64ee-ea1f-4be2-9067-efac85b4cc5c started at 2023-03-24 03:35:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:38:06.011: INFO: Container busybox ready: true, restart count 0 Mar 24 03:38:06.011: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:38:06.011: INFO: Container back-off-cap ready: false, restart count 6 Mar 24 03:38:06.011: INFO: pod-projected-configmaps-39d603fc-c96f-4df3-b9d0-3cf94f758944 started at 2023-03-24 03:35:44 +0000 UTC (0+1 container statuses recorded) Mar 24 03:38:06.011: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:38:06.011: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:38:06.012: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:38:06.012: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:38:06.012: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:38:06.012: INFO: pod-handle-http-request started at 2023-03-24 03:36:01 +0000 UTC (0+2 container statuses recorded) Mar 24 03:38:06.012: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:38:06.012: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:38:06.012: INFO: pod-with-poststart-exec-hook started at 2023-03-24 03:36:03 +0000 UTC (0+1 container statuses recorded) Mar 24 03:38:06.012: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 W0324 03:38:06.012836 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:38:06.054: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:38:06.054 (62ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:38:06.054 (62ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:38:06.054 STEP: Destroying namespace "container-lifecycle-hook-90" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:38:06.054 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:38:06.057 (2ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc000c03100>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 03:28:27.467from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:26:23.402 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:26:23.403 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 03:26:23.403 Mar 24 03:26:23.410: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:26:23.41 (8ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:26:23.41 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:26:23.41 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:26:23.41 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 03:26:23.413 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:26:25.444 (2.033s) > Enter [It] should execute poststart http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:168 @ 03/24/23 03:26:25.444 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 03:26:25.444 STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 03:26:27.466 [FAILED] Timed out after 120.001s. Expected <*errors.errorString | 0xc000c03100>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 03:28:27.467 < Exit [It] should execute poststart http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:168 @ 03/24/23 03:28:27.467 (2m2.023s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:27.467 Mar 24 03:28:27.467: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:27.469 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:27.469 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:27.469 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:28:27.469 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:27.469 STEP: Collecting events from namespace "container-lifecycle-hook-4850". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:28:27.469 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:28:27.471 Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:23 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:23 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:23 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:23 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:23 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:24 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:25 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:25 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container pod-with-poststart-http-hook Mar 24 03:28:27.471: INFO: At 2023-03-24 03:26:26 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container pod-with-poststart-http-hook Mar 24 03:28:27.473: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:28:27.473: INFO: pod-handle-http-request tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:23 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:24 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:24 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:23 +0000 UTC }] Mar 24 03:28:27.473: INFO: pod-with-poststart-http-hook tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:25 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:26 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:26 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:25 +0000 UTC }] Mar 24 03:28:27.473: INFO: Mar 24 03:28:27.474: INFO: Unable to fetch container-lifecycle-hook-4850/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-4850/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 709; INTERNAL_ERROR; received from peer Mar 24 03:28:27.475: INFO: Unable to fetch container-lifecycle-hook-4850/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-4850/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 711; INTERNAL_ERROR; received from peer Mar 24 03:28:27.477: INFO: Unable to fetch container-lifecycle-hook-4850/pod-with-poststart-http-hook/pod-with-poststart-http-hook logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-4850/pods/pod-with-poststart-http-hook/log?container=pod-with-poststart-http-hook&previous=false&tailLines=42": stream error: stream ID 713; INTERNAL_ERROR; received from peer Mar 24 03:28:27.478: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:27.479: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:28:27.479: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:27.480: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:27.484: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:28:27.484: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:28:27.484: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:28:27.484: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:28:27.484: INFO: pod-b63cb353-1d14-4146-bce0-30c77ecc1132 started at 2023-03-24 03:28:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:27.484: INFO: Container test-container ready: false, restart count 0 Mar 24 03:28:27.484: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:27.484: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:28:27.484: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:28:27.484: INFO: sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7 started at 2023-03-24 03:28:23 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:27.484: INFO: Container test-container ready: false, restart count 0 Mar 24 03:28:27.484: INFO: pod-with-poststart-http-hook started at 2023-03-24 03:26:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:27.484: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 03:28:27.484: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:27.484: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:28:27.484: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:27.484: INFO: Container back-off ready: false, restart count 3 Mar 24 03:28:27.484: INFO: pod-handle-http-request started at 2023-03-24 03:26:23 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:27.484: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:28:27.484: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:28:27.484: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:27.484: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:28:27.484: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:27.484: INFO: Container client-container ready: false, restart count 0 W0324 03:28:27.485508 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:28:27.531: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:27.531 (62ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:28:27.531 (62ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:28:27.531 STEP: Destroying namespace "container-lifecycle-hook-4850" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:28:27.531 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:28:27.533 (2ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttps\shook\sproperly\s\[MinimumKubeletVersion\:1\.23\]\s\[NodeConformance\]$'
[FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc000e0ce60>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 03:27:41.089from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:25:37.023 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:37.023 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:37.023 Mar 24 03:25:37.028: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:25:37.028 (6ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:37.028 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:37.028 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:25:37.028 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 03:25:37.032 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:25:39.066 (2.037s) > Enter [It] should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:190 @ 03/24/23 03:25:39.066 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 03:25:39.066 STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 03:25:41.088 [FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc000e0ce60>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 03:27:41.089 < Exit [It] should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:190 @ 03/24/23 03:27:41.089 (2m2.023s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:27:41.089 Mar 24 03:27:41.089: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:27:41.091 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:27:41.091 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:27:41.091 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:27:41.091 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:27:41.091 STEP: Collecting events from namespace "container-lifecycle-hook-7176". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:27:41.091 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:27:41.093 Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:37 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:37 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:37 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:37 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:37 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:37 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-with-poststart-https-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-with-poststart-https-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container pod-with-poststart-https-hook Mar 24 03:27:41.093: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-with-poststart-https-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container pod-with-poststart-https-hook Mar 24 03:27:41.094: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:27:41.094: INFO: pod-handle-http-request tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:37 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:38 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:38 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:37 +0000 UTC }] Mar 24 03:27:41.094: INFO: pod-with-poststart-https-hook tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:39 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:40 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:40 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:39 +0000 UTC }] Mar 24 03:27:41.094: INFO: Mar 24 03:27:41.096: INFO: Unable to fetch container-lifecycle-hook-7176/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-7176/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 537; INTERNAL_ERROR; received from peer Mar 24 03:27:41.097: INFO: Unable to fetch container-lifecycle-hook-7176/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-7176/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 539; INTERNAL_ERROR; received from peer Mar 24 03:27:41.099: INFO: Unable to fetch container-lifecycle-hook-7176/pod-with-poststart-https-hook/pod-with-poststart-https-hook logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-7176/pods/pod-with-poststart-https-hook/log?container=pod-with-poststart-https-hook&previous=false&tailLines=42": stream error: stream ID 541; INTERNAL_ERROR; received from peer Mar 24 03:27:41.100: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:41.101: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:27:41.101: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:41.102: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:41.106: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:41.106: INFO: Container client-container ready: true, restart count 0 Mar 24 03:27:41.106: INFO: pod-with-poststart-https-hook started at 2023-03-24 03:25:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:41.106: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 Mar 24 03:27:41.106: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:41.106: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:27:41.106: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:27:41.106: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:27:41.106: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:27:41.106: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:27:41.106: INFO: pod-handle-http-request started at 2023-03-24 03:25:37 +0000 UTC (0+2 container statuses recorded) Mar 24 03:27:41.106: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:27:41.106: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:27:41.106: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:27:41.106: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:27:41.106: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:27:41.106: INFO: busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 started at 2023-03-24 03:26:15 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:41.106: INFO: Container busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 ready: true, restart count 0 Mar 24 03:27:41.106: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:41.106: INFO: Container back-off ready: false, restart count 2 Mar 24 03:27:41.106: INFO: pod-handle-http-request started at 2023-03-24 03:26:23 +0000 UTC (0+2 container statuses recorded) Mar 24 03:27:41.106: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:27:41.106: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:27:41.106: INFO: pod-with-poststart-http-hook started at 2023-03-24 03:26:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:41.106: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 03:27:41.106: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:41.106: INFO: Container test-webserver ready: true, restart count 0 W0324 03:27:41.107510 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:27:41.163: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:27:41.163 (73ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:27:41.163 (73ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:27:41.163 STEP: Destroying namespace "container-lifecycle-hook-7176" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:27:41.164 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:27:41.166 (2ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc000f95b80>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 03:32:51.387from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:32:15.33 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:32:15.33 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 03:32:15.33 Mar 24 03:32:15.333: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:32:15.333 (3ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:32:15.333 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:32:15.333 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:32:15.333 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 03:32:15.335 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:32:17.35 (2.017s) > Enter [It] should execute prestop exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:152 @ 03/24/23 03:32:17.35 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 03:32:17.35 STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 03:32:19.37 STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 03:32:21.386 [FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc000f95b80>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 03:32:51.387 < Exit [It] should execute prestop exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:152 @ 03/24/23 03:32:51.387 (34.037s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:51.387 Mar 24 03:32:51.387: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:51.389 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:51.389 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:51.389 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:32:51.389 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:51.389 STEP: Collecting events from namespace "container-lifecycle-hook-9633". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:32:51.389 STEP: Found 10 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:32:51.392 Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:15 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:15 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:15 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:15 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:15 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:16 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:17 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:17 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container pod-with-prestop-exec-hook Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:17 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container pod-with-prestop-exec-hook Mar 24 03:32:51.392: INFO: At 2023-03-24 03:32:19 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Killing: Stopping container pod-with-prestop-exec-hook Mar 24 03:32:51.393: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:32:51.393: INFO: pod-handle-http-request tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:15 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:16 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:16 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:15 +0000 UTC }] Mar 24 03:32:51.393: INFO: Mar 24 03:32:51.395: INFO: Unable to fetch container-lifecycle-hook-9633/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-9633/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 953; INTERNAL_ERROR; received from peer Mar 24 03:32:51.396: INFO: Unable to fetch container-lifecycle-hook-9633/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-9633/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 955; INTERNAL_ERROR; received from peer Mar 24 03:32:51.398: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:51.399: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:32:51.399: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:51.400: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:51.404: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:51.404: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:32:51.404: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:32:51.404: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:32:51.404: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:51.404: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:32:51.404: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:51.404: INFO: Container back-off ready: false, restart count 5 Mar 24 03:32:51.404: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:51.404: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:32:51.404: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:32:51.404: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:32:51.404: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:51.404: INFO: Container back-off-cap ready: false, restart count 3 Mar 24 03:32:51.404: INFO: pod-handle-http-request started at 2023-03-24 03:32:15 +0000 UTC (0+2 container statuses recorded) Mar 24 03:32:51.404: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:32:51.404: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:32:51.404: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:51.404: INFO: Container client-container ready: true, restart count 0 W0324 03:32:51.405198 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:32:51.475: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:51.475 (86ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:32:51.475 (86ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:32:51.475 STEP: Destroying namespace "container-lifecycle-hook-9633" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:32:51.476 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:32:51.478 (3ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 30.000s. Expected <*errors.errorString | 0xc0012c37a0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 03:26:14.837from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:25:38.768 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:38.768 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:38.768 Mar 24 03:25:38.771: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:25:38.771 (3ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:38.771 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:38.771 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:25:38.771 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 03:25:38.772 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:25:40.793 (2.022s) > Enter [It] should execute prestop http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:213 @ 03/24/23 03:25:40.793 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 03:25:40.793 STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 03:25:42.83 STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 03:25:44.837 [FAILED] Timed out after 30.000s. Expected <*errors.errorString | 0xc0012c37a0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 03:26:14.837 < Exit [It] should execute prestop http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:213 @ 03/24/23 03:26:14.837 (34.044s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:26:14.837 Mar 24 03:26:14.837: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:26:14.839 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:26:14.839 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:26:14.839 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:26:14.839 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:26:14.839 STEP: Collecting events from namespace "container-lifecycle-hook-8581". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:26:14.839 STEP: Found 10 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:26:14.841 Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:39 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:41 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:41 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container pod-with-prestop-http-hook Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:41 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container pod-with-prestop-http-hook Mar 24 03:26:14.841: INFO: At 2023-03-24 03:25:43 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Killing: Stopping container pod-with-prestop-http-hook Mar 24 03:26:14.843: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:26:14.843: INFO: pod-handle-http-request tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:38 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:40 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:40 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:38 +0000 UTC }] Mar 24 03:26:14.843: INFO: Mar 24 03:26:14.844: INFO: Unable to fetch container-lifecycle-hook-8581/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-8581/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 359; INTERNAL_ERROR; received from peer Mar 24 03:26:14.847: INFO: Unable to fetch container-lifecycle-hook-8581/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-8581/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 361; INTERNAL_ERROR; received from peer Mar 24 03:26:14.851: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:26:14.854: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:26:14.854: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:26:14.857: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:26:14.865: INFO: stats-busybox-0 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container busybox-container ready: true, restart count 1 Mar 24 03:26:14.865: INFO: pod-handle-http-request started at 2023-03-24 03:25:38 +0000 UTC (0+2 container statuses recorded) Mar 24 03:26:14.865: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:26:14.865: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:26:14.865: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:26:14.865: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:26:14.865: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:26:14.865: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:26:14.865: INFO: liveness-9d30a6b7-ed46-44f9-b7f4-92e25185a7da started at 2023-03-24 03:25:56 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:26:14.865: INFO: pod-handle-http-request started at 2023-03-24 03:25:37 +0000 UTC (0+2 container statuses recorded) Mar 24 03:26:14.865: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:26:14.865: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:26:14.865: INFO: busybox-336f925c-8a13-4887-985b-23d76fe24869 started at 2023-03-24 03:25:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container busybox ready: false, restart count 0 Mar 24 03:26:14.865: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container client-container ready: true, restart count 0 Mar 24 03:26:14.865: INFO: pod-update-2aaf5786-3dfc-4264-92fe-4b1bcab9bad6 started at 2023-03-24 03:26:13 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container pause ready: true, restart count 0 Mar 24 03:26:14.865: INFO: pod-with-poststart-https-hook started at 2023-03-24 03:25:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 Mar 24 03:26:14.865: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:26:14.865: INFO: stats-busybox-1 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:14.865: INFO: Container busybox-container ready: true, restart count 1 W0324 03:26:14.869168 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:26:14.999: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:26:14.999 (160ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:26:14.999 (160ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:26:14.999 STEP: Destroying namespace "container-lifecycle-hook-8581" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:26:15 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:26:15.013 (14ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\shttps\shook\sproperly\s\[MinimumKubeletVersion\:1\.23\]\s\[NodeConformance\]$'
[FAILED] Timed out after 30.000s. Expected <*errors.errorString | 0xc0018caa50>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 03:34:11.851from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:33:35.79 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:33:35.79 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 03:33:35.79 Mar 24 03:33:35.793: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 03:33:35.793 (3ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:35.793 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:35.793 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:33:35.793 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 03:33:35.795 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 03:33:37.817 (2.024s) > Enter [It] should execute prestop https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:235 @ 03/24/23 03:33:37.817 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 03:33:37.817 STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 03:33:39.843 STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 03:33:41.85 [FAILED] Timed out after 30.000s. Expected <*errors.errorString | 0xc0018caa50>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 03:34:11.851 < Exit [It] should execute prestop https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:235 @ 03/24/23 03:34:11.851 (34.034s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:11.851 Mar 24 03:34:11.851: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:11.859 (8ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:11.859 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:11.859 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:34:11.859 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:11.859 STEP: Collecting events from namespace "container-lifecycle-hook-2644". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:34:11.859 STEP: Found 10 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:34:11.862 Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:36 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:38 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:38 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container pod-with-prestop-https-hook Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:38 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container pod-with-prestop-https-hook Mar 24 03:34:11.862: INFO: At 2023-03-24 03:33:40 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Killing: Stopping container pod-with-prestop-https-hook Mar 24 03:34:11.863: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:34:11.863: INFO: pod-handle-http-request tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:35 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:36 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:36 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:35 +0000 UTC }] Mar 24 03:34:11.863: INFO: Mar 24 03:34:11.866: INFO: Unable to fetch container-lifecycle-hook-2644/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-2644/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 1151; INTERNAL_ERROR; received from peer Mar 24 03:34:11.868: INFO: Unable to fetch container-lifecycle-hook-2644/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-2644/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 1153; INTERNAL_ERROR; received from peer Mar 24 03:34:11.871: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:11.873: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:34:11.873: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:11.874: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:11.877: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:11.877: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:34:11.877: INFO: downwardapi-volume-996a384e-3259-45a6-a8d1-be806b8cca27 started at 2023-03-24 03:34:09 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:11.877: INFO: Container client-container ready: false, restart count 0 Mar 24 03:34:11.877: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:11.877: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:34:11.877: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:11.877: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:11.877: INFO: pod-handle-http-request started at 2023-03-24 03:33:35 +0000 UTC (0+2 container statuses recorded) Mar 24 03:34:11.877: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:34:11.877: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:34:11.877: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:11.877: INFO: Container test ready: true, restart count 0 Mar 24 03:34:11.877: INFO: terminate-cmd-rpn3aa24d10-64f7-4c5b-9b91-131ccdfbe3fe started at 2023-03-24 03:34:10 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:11.877: INFO: Container terminate-cmd-rpn ready: false, restart count 0 Mar 24 03:34:11.877: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:11.877: INFO: Container client-container ready: true, restart count 0 W0324 03:34:11.879369 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:34:14.388: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:14.388 (2.529s) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 03:34:14.388 (2.529s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:34:14.388 STEP: Destroying namespace "container-lifecycle-hook-2644" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:34:14.388 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 03:34:14.394 (6ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\sarguments\s\(container\scmd\)\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-5361/pods/client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29/log?container=agnhost-container&previous=false": stream error: stream ID 561; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:09.47from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:29:05.432 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:29:05.432 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 03:29:05.432 Mar 24 03:29:05.434: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:29:05.434 (3ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:05.434 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:05.434 (0s) > Enter [It] should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:61 @ 03/24/23 03:29:05.434 STEP: Creating a pod to test override arguments - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:29:05.434 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:29:09.455 Mar 24 03:29:09.456: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29 container agnhost-container: <nil> Mar 24 03:29:09.458: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/containers-5361/pods/client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29/log?container=agnhost-container&previous=false": stream error: stream ID 561; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:29:09.458 Mar 24 03:29:09.470: INFO: Unexpected error: <*fmt.wrapError | 0xc00169d8a0>: failed to get logs from client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-5361/pods/client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29/log?container=agnhost-container&previous=false": stream error: stream ID 561; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/containers-5361/pods/client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29/log?container=agnhost-container&previous=false\": stream error: stream ID 561; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0016fe420>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-5361/pods/client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 561, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-5361/pods/client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29/log?container=agnhost-container&previous=false": stream error: stream ID 561; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:09.47 < Exit [It] should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:61 @ 03/24/23 03:29:09.47 (4.035s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:09.47 Mar 24 03:29:09.470: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:09.472 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:09.472 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:09.472 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:29:09.472 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:09.473 STEP: Collecting events from namespace "containers-5361". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:29:09.473 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:29:09.474 Mar 24 03:29:09.474: INFO: At 2023-03-24 03:29:06 +0000 UTC - event for client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:29:09.474: INFO: At 2023-03-24 03:29:06 +0000 UTC - event for client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:29:09.474: INFO: At 2023-03-24 03:29:06 +0000 UTC - event for client-containers-8de364c5-26b9-4826-b6d4-2cc52825ed29: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:29:09.474: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:29:09.474: INFO: Mar 24 03:29:09.476: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:09.477: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:29:09.477: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:09.478: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:09.482: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:29:09.482: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:29:09.482: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:29:09.482: INFO: test-container-pod started at 2023-03-24 03:29:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:09.482: INFO: Container webserver ready: true, restart count 0 Mar 24 03:29:09.482: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:09.482: INFO: Container createcm-volume-test ready: false, restart count 0 Mar 24 03:29:09.482: INFO: Container delcm-volume-test ready: false, restart count 0 Mar 24 03:29:09.482: INFO: Container updcm-volume-test ready: false, restart count 0 Mar 24 03:29:09.482: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:09.482: INFO: Container back-off ready: false, restart count 4 Mar 24 03:29:09.482: INFO: container-must-be-restarted started at 2023-03-24 03:28:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:09.482: INFO: Container regular-1 ready: false, restart count 2 Mar 24 03:29:09.482: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:09.482: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:29:09.482: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:09.482: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:29:09.482: INFO: netserver-0 started at 2023-03-24 03:28:45 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:09.482: INFO: Container webserver ready: true, restart count 0 Mar 24 03:29:09.482: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:09.482: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:29:09.482: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:29:09.482: INFO: Container updcm-volume-test ready: true, restart count 0 W0324 03:29:09.483010 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:29:09.538: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:09.538 (66ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:29:09.538 (66ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:29:09.538 STEP: Destroying namespace "containers-5361" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:29:09.538 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:29:09.54 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\s\(container\sentrypoint\)\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8381/pods/client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415/log?container=agnhost-container&previous=false": stream error: stream ID 1183; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:18.45from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:34:14.395 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:34:14.395 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 03:34:14.395 Mar 24 03:34:14.398: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:34:14.398 (3ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:14.398 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:14.398 (0s) > Enter [It] should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:75 @ 03/24/23 03:34:14.398 STEP: Creating a pod to test override command - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:34:14.398 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:34:18.442 Mar 24 03:34:18.443: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415 container agnhost-container: <nil> Mar 24 03:34:18.445: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8381/pods/client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415/log?container=agnhost-container&previous=false": stream error: stream ID 1183; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:34:18.445 Mar 24 03:34:18.449: INFO: Unexpected error: <*fmt.wrapError | 0xc00187d740>: failed to get logs from client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8381/pods/client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415/log?container=agnhost-container&previous=false": stream error: stream ID 1183; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/containers-8381/pods/client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415/log?container=agnhost-container&previous=false\": stream error: stream ID 1183; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000e22db0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-8381/pods/client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1183, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8381/pods/client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415/log?container=agnhost-container&previous=false": stream error: stream ID 1183; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:18.45 < Exit [It] should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:75 @ 03/24/23 03:34:18.45 (4.052s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:18.45 Mar 24 03:34:18.450: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:18.451 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:18.451 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:18.451 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:34:18.451 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:18.451 STEP: Collecting events from namespace "containers-8381". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:34:18.451 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:34:18.452 Mar 24 03:34:18.452: INFO: At 2023-03-24 03:34:15 +0000 UTC - event for client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:34:18.452: INFO: At 2023-03-24 03:34:15 +0000 UTC - event for client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:34:18.452: INFO: At 2023-03-24 03:34:15 +0000 UTC - event for client-containers-0bf9f49d-c5d9-4fde-bc83-ada51e781415: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:34:18.453: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:34:18.453: INFO: Mar 24 03:34:18.454: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:18.456: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:34:18.456: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:18.457: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:18.460: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:34:18.460: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:34:18.460: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:34:18.460: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:34:18.460: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:18.460: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:34:18.460: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:18.460: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:18.460: INFO: pod-handle-http-request started at 2023-03-24 03:33:35 +0000 UTC (0+2 container statuses recorded) Mar 24 03:34:18.460: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:34:18.460: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:34:18.460: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:18.460: INFO: Container test ready: true, restart count 0 Mar 24 03:34:18.460: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:18.460: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:18.460: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:18.460: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:34:18.460: INFO: busybox-user-0-e4f0c346-0473-419e-9b97-08bcd9b0c7fa started at 2023-03-24 03:34:14 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:18.460: INFO: Container busybox-user-0-e4f0c346-0473-419e-9b97-08bcd9b0c7fa ready: false, restart count 0 W0324 03:34:18.461267 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:34:23.761: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:23.761 (5.31s) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:34:23.761 (5.31s) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:34:23.761 STEP: Destroying namespace "containers-8381" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:34:23.761 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:34:23.766 (5ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\sand\sarguments\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-3a2944f4-798b-403a-8847-395b9775f3e6 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8022/pods/client-containers-3a2944f4-798b-403a-8847-395b9775f3e6/log?container=agnhost-container&previous=false": stream error: stream ID 83; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:24:52.675from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:24:46.536 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:24:46.536 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 03:24:46.536 Mar 24 03:24:46.543: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:24:46.543 (7ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:46.543 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:46.543 (0s) > Enter [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:89 @ 03/24/23 03:24:46.543 STEP: Creating a pod to test override all - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:24:46.543 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:24:52.666 Mar 24 03:24:52.667: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod client-containers-3a2944f4-798b-403a-8847-395b9775f3e6 container agnhost-container: <nil> Mar 24 03:24:52.669: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "client-containers-3a2944f4-798b-403a-8847-395b9775f3e6" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8022/pods/client-containers-3a2944f4-798b-403a-8847-395b9775f3e6/log?container=agnhost-container&previous=false": stream error: stream ID 83; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:24:52.669 Mar 24 03:24:52.675: INFO: Unexpected error: <*fmt.wrapError | 0xc000b76e00>: failed to get logs from client-containers-3a2944f4-798b-403a-8847-395b9775f3e6 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8022/pods/client-containers-3a2944f4-798b-403a-8847-395b9775f3e6/log?container=agnhost-container&previous=false": stream error: stream ID 83; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-3a2944f4-798b-403a-8847-395b9775f3e6 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/containers-8022/pods/client-containers-3a2944f4-798b-403a-8847-395b9775f3e6/log?container=agnhost-container&previous=false\": stream error: stream ID 83; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0011f45a0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-8022/pods/client-containers-3a2944f4-798b-403a-8847-395b9775f3e6/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 83, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-3a2944f4-798b-403a-8847-395b9775f3e6 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-8022/pods/client-containers-3a2944f4-798b-403a-8847-395b9775f3e6/log?container=agnhost-container&previous=false": stream error: stream ID 83; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:24:52.675 < Exit [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:89 @ 03/24/23 03:24:52.675 (6.132s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:24:52.675 Mar 24 03:24:52.675: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:24:52.676 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:24:52.676 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:24:52.676 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:24:52.676 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:24:52.676 STEP: Collecting events from namespace "containers-8022". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:24:52.676 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:24:52.679 Mar 24 03:24:52.679: INFO: At 2023-03-24 03:24:49 +0000 UTC - event for client-containers-3a2944f4-798b-403a-8847-395b9775f3e6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:24:52.679: INFO: At 2023-03-24 03:24:49 +0000 UTC - event for client-containers-3a2944f4-798b-403a-8847-395b9775f3e6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:24:52.679: INFO: At 2023-03-24 03:24:49 +0000 UTC - event for client-containers-3a2944f4-798b-403a-8847-395b9775f3e6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:24:52.681: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:24:52.681: INFO: Mar 24 03:24:52.683: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:24:52.684: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 87 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:24:35 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:24:52.684: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:24:52.685: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:24:52.689: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:52.689: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:24:52.689: INFO: pod-projected-secrets-a6a9e4ad-25dd-4936-aaee-38153bfcfc50 started at 2023-03-24 03:24:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:52.689: INFO: Container projected-secret-volume-test ready: false, restart count 0 Mar 24 03:24:52.689: INFO: shared-pid-ns-test-pod started at 2023-03-24 03:24:47 +0000 UTC (0+2 container statuses recorded) Mar 24 03:24:52.689: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 03:24:52.689: INFO: Container test-container-2 ready: true, restart count 0 Mar 24 03:24:52.689: INFO: pod-init-b4fd117c-c167-4e16-8573-b781a2256267 started at 2023-03-24 03:24:49 +0000 UTC (2+1 container statuses recorded) Mar 24 03:24:52.689: INFO: Init container init1 ready: true, restart count 0 Mar 24 03:24:52.689: INFO: Init container init2 ready: false, restart count 0 Mar 24 03:24:52.689: INFO: Container run1 ready: false, restart count 0 Mar 24 03:24:52.689: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:52.689: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:24:52.689: INFO: bin-false3e466448-7159-4ff0-a0ef-2e816773f181 started at 2023-03-24 03:24:52 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:52.689: INFO: Container bin-false3e466448-7159-4ff0-a0ef-2e816773f181 ready: false, restart count 0 Mar 24 03:24:52.689: INFO: poda331cd66-046f-46c8-8592-61ff8fe83dda started at 2023-03-24 03:24:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:52.689: INFO: Container containere4b76138-7a38-409c-aa4d-52090292f485 ready: false, restart count 0 Mar 24 03:24:52.689: INFO: podbac21578-6bed-40a3-bf09-d1aa5102fb05 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:52.689: INFO: Container container684a39a7-a3af-47b6-b26f-a1d4becb581d ready: false, restart count 0 W0324 03:24:52.690239 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:24:53.119: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:24:53.119 (443ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:24:53.119 (443ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:24:53.12 STEP: Destroying namespace "containers-8022" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:24:53.123 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:24:53.129 (9ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\suse\sthe\simage\sdefaults\sif\scommand\sand\sargs\sare\sblank\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 3.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc000f8e4e0>: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-1729/pods/client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0/log?container=agnhost-container&previous=false": stream error: stream ID 751; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-1729/pods/client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 751, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/node/containers.go:53 @ 03/24/23 03:31:46.757from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:31:41.721 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:31:41.721 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 03:31:41.721 Mar 24 03:31:41.726: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 03:31:41.726 (5ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:41.726 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:41.726 (0s) > Enter [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:41 @ 03/24/23 03:31:41.726 [FAILED] Timed out after 3.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc000f8e4e0>: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-1729/pods/client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0/log?container=agnhost-container&previous=false": stream error: stream ID 751; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-1729/pods/client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 751, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/node/containers.go:53 @ 03/24/23 03:31:46.757 < Exit [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:41 @ 03/24/23 03:31:46.757 (5.031s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:31:46.757 Mar 24 03:31:46.757: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:31:46.759 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:31:46.759 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:31:46.759 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:31:46.759 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:31:46.759 STEP: Collecting events from namespace "containers-1729". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:31:46.759 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:31:46.761 Mar 24 03:31:46.761: INFO: At 2023-03-24 03:31:42 +0000 UTC - event for client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:31:46.761: INFO: At 2023-03-24 03:31:42 +0000 UTC - event for client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:31:46.761: INFO: At 2023-03-24 03:31:42 +0000 UTC - event for client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:31:46.762: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:31:46.762: INFO: client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:41 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:42 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:42 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:41 +0000 UTC }] Mar 24 03:31:46.762: INFO: Mar 24 03:31:46.764: INFO: Unable to fetch containers-1729/client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-1729/pods/client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 759; INTERNAL_ERROR; received from peer Mar 24 03:31:46.766: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:46.768: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:31:46.768: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:46.769: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:46.774: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:46.774: INFO: Container client-container ready: true, restart count 0 Mar 24 03:31:46.774: INFO: liveness-8fd39a75-ca01-4e98-bd13-421a17c3db7d started at 2023-03-24 03:29:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:46.774: INFO: Container agnhost-container ready: false, restart count 4 Mar 24 03:31:46.774: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:31:46.774: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:31:46.774: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:31:46.774: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:31:46.774: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:46.774: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:31:46.774: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:46.774: INFO: Container back-off ready: false, restart count 5 Mar 24 03:31:46.774: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:31:46.774: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:31:46.774: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:31:46.774: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:31:46.774: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:46.774: INFO: Container back-off-cap ready: true, restart count 1 Mar 24 03:31:46.774: INFO: client-containers-de645f84-8a03-4fac-ba4f-e21375b4e6b0 started at 2023-03-24 03:31:41 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:46.774: INFO: Container agnhost-container ready: true, restart count 0 W0324 03:31:46.775668 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:31:46.864: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:31:46.864 (105ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 03:31:46.864 (105ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:31:46.864 STEP: Destroying namespace "containers-1729" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:31:46.864 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 03:31:46.867 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\scontainer\'s\slimits\.cpu\/memory\sand\srequests\.cpu\/memory\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5973/pods/downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce/log?container=dapi-container&previous=false": stream error: stream ID 121; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:09.607from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:25:05.561 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:05.561 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:05.561 Mar 24 03:25:05.564: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:25:05.564 (3ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:05.564 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:05.564 (0s) > Enter [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:167 @ 03/24/23 03:25:05.564 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:25:05.564 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:25:09.586 Mar 24 03:25:09.588: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce container dapi-container: <nil> Mar 24 03:25:09.594: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5973/pods/downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce/log?container=dapi-container&previous=false": stream error: stream ID 121; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:25:09.594 Mar 24 03:25:09.607: INFO: Unexpected error: <*fmt.wrapError | 0xc000211660>: failed to get logs from downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5973/pods/downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce/log?container=dapi-container&previous=false": stream error: stream ID 121; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-5973/pods/downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce/log?container=dapi-container&previous=false\": stream error: stream ID 121; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00116d110>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5973/pods/downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 121, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5973/pods/downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce/log?container=dapi-container&previous=false": stream error: stream ID 121; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:09.607 < Exit [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:167 @ 03/24/23 03:25:09.607 (4.043s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:09.607 Mar 24 03:25:09.607: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:09.609 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:09.609 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:09.609 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:25:09.609 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:09.609 STEP: Collecting events from namespace "downward-api-5973". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:25:09.609 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:25:09.613 Mar 24 03:25:09.613: INFO: At 2023-03-24 03:25:06 +0000 UTC - event for downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:25:09.613: INFO: At 2023-03-24 03:25:06 +0000 UTC - event for downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:25:09.613: INFO: At 2023-03-24 03:25:06 +0000 UTC - event for downward-api-9a0e689c-ab9d-4241-9d70-9f256b3196ce: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:25:09.615: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:25:09.615: INFO: Mar 24 03:25:09.618: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:09.623: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:25:09.623: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:09.627: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:09.632: INFO: log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 ready: false, restart count 0 Mar 24 03:25:09.632: INFO: pod51e69781-66dd-4938-9447-45259953fe14 started at 2023-03-24 03:24:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container container33ed3425-ff63-4dac-887a-19a0f9af1c27 ready: false, restart count 0 Mar 24 03:25:09.632: INFO: pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:25:09.632: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:25:09.632: INFO: stats-busybox-0 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container busybox-container ready: false, restart count 0 Mar 24 03:25:09.632: INFO: pod59544fef-132c-48a4-9c23-f2fab7a12d65 started at 2023-03-24 03:25:03 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container container5663a1ff-e6c4-4622-bf3e-1e564e4823dd ready: false, restart count 0 Mar 24 03:25:09.632: INFO: hostfqdn-166104 started at 2023-03-24 03:25:07 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container test-container ready: false, restart count 0 Mar 24 03:25:09.632: INFO: stats-busybox-1 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container busybox-container ready: false, restart count 0 Mar 24 03:25:09.632: INFO: pod-host-path-test started at 2023-03-24 03:25:08 +0000 UTC (0+2 container statuses recorded) Mar 24 03:25:09.632: INFO: Container test-container-1 ready: false, restart count 0 Mar 24 03:25:09.632: INFO: Container test-container-2 ready: false, restart count 0 Mar 24 03:25:09.632: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:25:09.632: INFO: log-pod-d96fc004-0636-46ba-8b56-a0669d739721 started at 2023-03-24 03:25:01 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:09.632: INFO: Container logger ready: false, restart count 0 W0324 03:25:09.638211 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:25:12.041: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:12.041 (2.433s) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:25:12.041 (2.433s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:25:12.041 STEP: Destroying namespace "downward-api-5973" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:25:12.041 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:25:12.046 (4ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\sdefault\slimits\.cpu\/memory\sfrom\snode\sallocatable\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7130/pods/downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1/log?container=dapi-container&previous=false": stream error: stream ID 1471; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:35:34.212from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:35:30.18 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:35:30.18 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:35:30.18 Mar 24 03:35:30.184: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:35:30.184 (4ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:30.184 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:30.184 (0s) > Enter [It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:218 @ 03/24/23 03:35:30.184 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:35:30.184 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:35:34.204 Mar 24 03:35:34.205: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1 container dapi-container: <nil> Mar 24 03:35:34.207: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7130/pods/downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1/log?container=dapi-container&previous=false": stream error: stream ID 1471; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:35:34.207 Mar 24 03:35:34.212: INFO: Unexpected error: <*fmt.wrapError | 0xc000af3fe0>: failed to get logs from downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7130/pods/downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1/log?container=dapi-container&previous=false": stream error: stream ID 1471; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-7130/pods/downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1/log?container=dapi-container&previous=false\": stream error: stream ID 1471; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0010efcb0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7130/pods/downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1471, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7130/pods/downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1/log?container=dapi-container&previous=false": stream error: stream ID 1471; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:35:34.212 < Exit [It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:218 @ 03/24/23 03:35:34.212 (4.028s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:34.212 Mar 24 03:35:34.212: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:34.214 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:34.214 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:34.214 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:35:34.214 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:34.214 STEP: Collecting events from namespace "downward-api-7130". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:35:34.214 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:35:34.215 Mar 24 03:35:34.215: INFO: At 2023-03-24 03:35:30 +0000 UTC - event for downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:35:34.215: INFO: At 2023-03-24 03:35:30 +0000 UTC - event for downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:35:34.215: INFO: At 2023-03-24 03:35:30 +0000 UTC - event for downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:35:34.216: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:35:34.216: INFO: Mar 24 03:35:34.218: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:34.219: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 4189 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:35:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:35:34.219: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:34.220: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:34.224: INFO: pod-exec-websocket-3dd9f1e0-7e4a-4e6a-aaad-3031d37ad42d started at 2023-03-24 03:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:34.224: INFO: Container main ready: true, restart count 0 Mar 24 03:35:34.224: INFO: podd3968ee7-1343-4513-8ee6-7b69bb6140e1 started at 2023-03-24 03:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:34.224: INFO: Container containerc5517caa-a6e0-4230-82a2-35962c8a7cc1 ready: false, restart count 0 Mar 24 03:35:34.224: INFO: termination-message-container2a119df5-2d9a-4870-93ea-272742f2d233 started at 2023-03-24 03:35:31 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:34.224: INFO: Container termination-message-container ready: false, restart count 0 Mar 24 03:35:34.224: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:34.224: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:35:34.224: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:34.224: INFO: Container back-off-cap ready: false, restart count 5 Mar 24 03:35:34.224: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:34.224: INFO: Container client-container ready: true, restart count 0 Mar 24 03:35:34.224: INFO: pod866ab006-2454-4868-a0b5-35752dbf6d60 started at 2023-03-24 03:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:34.224: INFO: Container container7f62bcd7-bdd9-4ba8-8a8b-c6975b74cc19 ready: false, restart count 0 Mar 24 03:35:34.224: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:35:34.224: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:35:34.224: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:35:34.224: INFO: Container upds-volume-test ready: true, restart count 0 W0324 03:35:34.225021 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:35:35.075: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:35.075 (861ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:35:35.075 (861ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:35:35.075 STEP: Destroying namespace "downward-api-7130" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:35:35.075 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:35:35.079 (4ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\shost\sIP\sas\san\senv\svar\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4581/pods/downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff/log?container=dapi-container&previous=false": stream error: stream ID 987; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:33:39.035from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:33:34.999 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:33:34.999 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:33:34.999 Mar 24 03:33:35.002: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:33:35.002 (3ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:35.002 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:35.002 (0s) > Enter [It] should provide host IP as an env var [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:91 @ 03/24/23 03:33:35.002 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:33:35.002 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:33:39.026 Mar 24 03:33:39.028: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff container dapi-container: <nil> Mar 24 03:33:39.029: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4581/pods/downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff/log?container=dapi-container&previous=false": stream error: stream ID 987; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:33:39.03 Mar 24 03:33:39.035: INFO: Unexpected error: <*fmt.wrapError | 0xc00122bac0>: failed to get logs from downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4581/pods/downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff/log?container=dapi-container&previous=false": stream error: stream ID 987; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-4581/pods/downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff/log?container=dapi-container&previous=false\": stream error: stream ID 987; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00117fce0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4581/pods/downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 987, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4581/pods/downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff/log?container=dapi-container&previous=false": stream error: stream ID 987; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:33:39.035 < Exit [It] should provide host IP as an env var [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:91 @ 03/24/23 03:33:39.035 (4.032s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:39.035 Mar 24 03:33:39.035: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:39.036 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:39.036 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:39.036 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:33:39.036 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:39.036 STEP: Collecting events from namespace "downward-api-4581". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:33:39.037 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:33:39.038 Mar 24 03:33:39.038: INFO: At 2023-03-24 03:33:35 +0000 UTC - event for downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:33:39.038: INFO: At 2023-03-24 03:33:35 +0000 UTC - event for downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:33:39.038: INFO: At 2023-03-24 03:33:35 +0000 UTC - event for downward-api-a0b10ac4-a7cf-4f3f-81cc-571aec7bedff: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:33:39.038: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:33:39.038: INFO: Mar 24 03:33:39.040: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:39.041: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:33:39.041: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:39.042: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:39.046: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container test ready: true, restart count 0 Mar 24 03:33:39.046: INFO: static-pod-5748b13b-04ec-48e5-be4e-81f49e3c16c3-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container test ready: false, restart count 0 Mar 24 03:33:39.046: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container client-container ready: true, restart count 0 Mar 24 03:33:39.046: INFO: pod-with-prestop-https-hook started at 2023-03-24 03:33:37 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container pod-with-prestop-https-hook ready: false, restart count 0 Mar 24 03:33:39.046: INFO: pod-handle-http-request started at 2023-03-24 03:33:35 +0000 UTC (0+2 container statuses recorded) Mar 24 03:33:39.046: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:33:39.046: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:33:39.046: INFO: test-webserver-1994fafa-ee2d-4154-b743-15a3b74d2469 started at 2023-03-24 03:33:13 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:33:39.046: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:33:39.046: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:33:39.046: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:33:39.046: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:33:39.046: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:33:39.046: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:33:39.046: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:39.046: INFO: Container back-off ready: false, restart count 7 W0324 03:33:39.047215 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:33:39.104: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:39.104 (68ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:33:39.104 (68ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:33:39.104 STEP: Destroying namespace "downward-api-4581" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:33:39.104 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:33:39.106 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\spod\sUID\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-180d4d74-0c49-49ca-ae68-876917aec09f for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6193/pods/downward-api-180d4d74-0c49-49ca-ae68-876917aec09f/log?container=dapi-container&previous=false": stream error: stream ID 677; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:31:59.135from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:31:55.09 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:31:55.09 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:31:55.09 Mar 24 03:31:55.101: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:31:55.101 (11ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:55.101 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:55.101 (0s) > Enter [It] should provide pod UID as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:268 @ 03/24/23 03:31:55.101 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:31:55.101 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:31:59.126 Mar 24 03:31:59.128: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downward-api-180d4d74-0c49-49ca-ae68-876917aec09f container dapi-container: <nil> Mar 24 03:31:59.129: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downward-api-180d4d74-0c49-49ca-ae68-876917aec09f" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6193/pods/downward-api-180d4d74-0c49-49ca-ae68-876917aec09f/log?container=dapi-container&previous=false": stream error: stream ID 677; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:31:59.129 Mar 24 03:31:59.134: INFO: Unexpected error: <*fmt.wrapError | 0xc0003beae0>: failed to get logs from downward-api-180d4d74-0c49-49ca-ae68-876917aec09f for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6193/pods/downward-api-180d4d74-0c49-49ca-ae68-876917aec09f/log?container=dapi-container&previous=false": stream error: stream ID 677; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-180d4d74-0c49-49ca-ae68-876917aec09f for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-6193/pods/downward-api-180d4d74-0c49-49ca-ae68-876917aec09f/log?container=dapi-container&previous=false\": stream error: stream ID 677; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001197050>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6193/pods/downward-api-180d4d74-0c49-49ca-ae68-876917aec09f/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 677, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-180d4d74-0c49-49ca-ae68-876917aec09f for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6193/pods/downward-api-180d4d74-0c49-49ca-ae68-876917aec09f/log?container=dapi-container&previous=false": stream error: stream ID 677; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:31:59.135 < Exit [It] should provide pod UID as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:268 @ 03/24/23 03:31:59.135 (4.033s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:31:59.135 Mar 24 03:31:59.135: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:31:59.136 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:31:59.136 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:31:59.136 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:31:59.136 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:31:59.136 STEP: Collecting events from namespace "downward-api-6193". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:31:59.136 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:31:59.138 Mar 24 03:31:59.138: INFO: At 2023-03-24 03:31:55 +0000 UTC - event for downward-api-180d4d74-0c49-49ca-ae68-876917aec09f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:31:59.138: INFO: At 2023-03-24 03:31:55 +0000 UTC - event for downward-api-180d4d74-0c49-49ca-ae68-876917aec09f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:31:59.138: INFO: At 2023-03-24 03:31:55 +0000 UTC - event for downward-api-180d4d74-0c49-49ca-ae68-876917aec09f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:31:59.138: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:31:59.138: INFO: Mar 24 03:31:59.140: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:59.141: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:31:59.141: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:59.142: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:59.146: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:31:59.146: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:31:59.146: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:31:59.146: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:31:59.146: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:59.146: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:31:59.146: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:59.146: INFO: Container back-off ready: false, restart count 5 Mar 24 03:31:59.146: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:31:59.146: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:31:59.146: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:31:59.146: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:31:59.146: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:59.146: INFO: Container back-off-cap ready: false, restart count 1 Mar 24 03:31:59.146: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:59.146: INFO: Container client-container ready: true, restart count 0 Mar 24 03:31:59.146: INFO: client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 started at 2023-03-24 03:31:57 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:59.146: INFO: Container env3cont ready: false, restart count 0 Mar 24 03:31:59.146: INFO: server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3 started at 2023-03-24 03:31:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:59.146: INFO: Container srv ready: true, restart count 0 W0324 03:31:59.147201 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:31:59.214: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:31:59.214 (78ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:31:59.214 (78ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:31:59.214 STEP: Destroying namespace "downward-api-6193" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:31:59.214 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:31:59.216 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\spod\sname\,\snamespace\sand\sIP\saddress\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4956/pods/downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d/log?container=dapi-container&previous=false": stream error: stream ID 929; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:31.95from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:29:27.915 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:29:27.915 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:29:27.915 Mar 24 03:29:27.918: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 03:29:27.918 (3ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:27.918 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:27.918 (0s) > Enter [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:45 @ 03/24/23 03:29:27.918 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:29:27.918 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:29:31.94 Mar 24 03:29:31.941: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d container dapi-container: <nil> Mar 24 03:29:31.944: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4956/pods/downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d/log?container=dapi-container&previous=false": stream error: stream ID 929; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:29:31.944 Mar 24 03:29:31.950: INFO: Unexpected error: <*fmt.wrapError | 0xc000211340>: failed to get logs from downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4956/pods/downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d/log?container=dapi-container&previous=false": stream error: stream ID 929; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-4956/pods/downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d/log?container=dapi-container&previous=false\": stream error: stream ID 929; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001559c80>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4956/pods/downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 929, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-4956/pods/downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d/log?container=dapi-container&previous=false": stream error: stream ID 929; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:31.95 < Exit [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:45 @ 03/24/23 03:29:31.95 (4.032s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:31.95 Mar 24 03:29:31.950: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:31.954 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:31.954 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:31.954 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:29:31.954 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:31.954 STEP: Collecting events from namespace "downward-api-4956". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:29:31.954 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:29:31.956 Mar 24 03:29:31.956: INFO: At 2023-03-24 03:29:28 +0000 UTC - event for downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:29:31.956: INFO: At 2023-03-24 03:29:28 +0000 UTC - event for downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:29:31.956: INFO: At 2023-03-24 03:29:28 +0000 UTC - event for downward-api-b88b1343-ce60-4d16-a56a-3ba41292067d: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:29:31.958: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:29:31.958: INFO: Mar 24 03:29:31.959: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:31.961: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:29:31.961: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:31.962: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:31.968: INFO: var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4 started at 2023-03-24 03:29:31 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:31.968: INFO: Container dapi-container ready: false, restart count 0 Mar 24 03:29:31.968: INFO: liveness-8fd39a75-ca01-4e98-bd13-421a17c3db7d started at 2023-03-24 03:29:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:31.968: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:29:31.968: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:31.968: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:29:31.968: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:29:31.968: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:29:31.968: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:29:31.968: INFO: test-host-network-pod started at 2023-03-24 03:29:28 +0000 UTC (0+2 container statuses recorded) Mar 24 03:29:31.968: INFO: Container busybox-1 ready: true, restart count 0 Mar 24 03:29:31.968: INFO: Container busybox-2 ready: true, restart count 0 Mar 24 03:29:31.968: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:31.968: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:29:31.968: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:29:31.968: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:29:31.968: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:31.968: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:29:31.968: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:31.968: INFO: Container back-off ready: false, restart count 4 Mar 24 03:29:31.968: INFO: container-must-be-restarted started at 2023-03-24 03:28:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:31.968: INFO: Container regular-1 ready: false, restart count 3 Mar 24 03:29:31.968: INFO: test-pod started at 2023-03-24 03:29:26 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:31.968: INFO: Container busybox-1 ready: true, restart count 0 Mar 24 03:29:31.968: INFO: Container busybox-2 ready: true, restart count 0 Mar 24 03:29:31.968: INFO: Container busybox-3 ready: true, restart count 0 W0324 03:29:31.970642 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:29:32.425: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:32.425 (471ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 03:29:32.425 (471ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:29:32.425 STEP: Destroying namespace "downward-api-4956" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:29:32.425 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 03:29:32.447 (23ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sEphemeral\sContainers\s\[NodeConformance\]\swill\sstart\san\sephemeral\scontainer\sin\san\sexisting\spod\s\[Conformance\]$'
[FAILED] Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-4536(867f5bb0-2eba-4198-a7f1-3722792ec05a)" ephemeral container "debugger": Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-4536/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 795; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/ephemeral_containers.go:81 @ 03/24/23 03:32:11.102from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:32:06.981 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:32:06.981 STEP: Building a namespace api object, basename ephemeral-containers-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:32:06.981 Mar 24 03:32:06.987: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:32:06.987 (6ms) > Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:32:06.987 < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:32:06.987 (0s) > Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/common/node/ephemeral_containers.go:39 @ 03/24/23 03:32:06.987 < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/common/node/ephemeral_containers.go:39 @ 03/24/23 03:32:06.987 (0s) > Enter [It] will start an ephemeral container in an existing pod [Conformance] - test/e2e/common/node/ephemeral_containers.go:46 @ 03/24/23 03:32:06.987 STEP: creating a target pod - test/e2e/common/node/ephemeral_containers.go:47 @ 03/24/23 03:32:06.987 STEP: adding an ephemeral container - test/e2e/common/node/ephemeral_containers.go:62 @ 03/24/23 03:32:09.014 STEP: checking pod container endpoints - test/e2e/common/node/ephemeral_containers.go:76 @ 03/24/23 03:32:11.045 Mar 24 03:32:11.045: INFO: ExecWithOptions {Command:[/bin/echo marco] Namespace:ephemeral-containers-test-4536 PodName:ephemeral-containers-target-pod ContainerName:debugger Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Mar 24 03:32:11.046: INFO: ExecWithOptions: Clientset creation Mar 24 03:32:11.046: INFO: ExecWithOptions: execute(POST https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-4536/pods/ephemeral-containers-target-pod/exec?command=%2Fbin%2Fecho&command=marco&container=debugger&container=debugger&stderr=true&stdout=true) Mar 24 03:32:11.099: INFO: Exec stderr: "" Mar 24 03:32:11.102: INFO: Unexpected error: Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-4536(867f5bb0-2eba-4198-a7f1-3722792ec05a)" ephemeral container "debugger": <*url.Error | 0xc000b13680>: Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-4536/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 795; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-4536/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false", Err: <http2.StreamError>{ StreamID: 795, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-4536(867f5bb0-2eba-4198-a7f1-3722792ec05a)" ephemeral container "debugger": Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-4536/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 795; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/ephemeral_containers.go:81 @ 03/24/23 03:32:11.102 < Exit [It] will start an ephemeral container in an existing pod [Conformance] - test/e2e/common/node/ephemeral_containers.go:46 @ 03/24/23 03:32:11.102 (4.114s) > Enter [AfterEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:11.102 Mar 24 03:32:11.102: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:11.105 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:11.105 < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:11.105 (0s) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:32:11.105 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:11.105 STEP: Collecting events from namespace "ephemeral-containers-test-4536". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:32:11.105 STEP: Found 6 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:32:11.106 Mar 24 03:32:11.106: INFO: At 2023-03-24 03:32:07 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:32:11.106: INFO: At 2023-03-24 03:32:07 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container test-container-1 Mar 24 03:32:11.106: INFO: At 2023-03-24 03:32:07 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container test-container-1 Mar 24 03:32:11.106: INFO: At 2023-03-24 03:32:09 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:32:11.106: INFO: At 2023-03-24 03:32:09 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container debugger Mar 24 03:32:11.106: INFO: At 2023-03-24 03:32:09 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container debugger Mar 24 03:32:11.108: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:32:11.108: INFO: ephemeral-containers-target-pod tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:06 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:07 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:07 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:32:06 +0000 UTC }] Mar 24 03:32:11.108: INFO: Mar 24 03:32:11.110: INFO: Unable to fetch ephemeral-containers-test-4536/ephemeral-containers-target-pod/test-container-1 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-4536/pods/ephemeral-containers-target-pod/log?container=test-container-1&previous=false&tailLines=42": stream error: stream ID 803; INTERNAL_ERROR; received from peer Mar 24 03:32:11.111: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:11.112: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:32:11.113: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:11.114: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:11.124: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:11.124: INFO: Container client-container ready: true, restart count 0 Mar 24 03:32:11.124: INFO: netserver-0 started at 2023-03-24 03:32:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:11.124: INFO: Container webserver ready: false, restart count 0 Mar 24 03:32:11.124: INFO: privileged-pod started at 2023-03-24 03:32:04 +0000 UTC (0+2 container statuses recorded) Mar 24 03:32:11.124: INFO: Container not-privileged-container ready: true, restart count 0 Mar 24 03:32:11.124: INFO: Container privileged-container ready: true, restart count 0 Mar 24 03:32:11.124: INFO: ephemeral-containers-target-pod started at 2023-03-24 03:32:06 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:11.124: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 03:32:11.124: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:11.124: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:32:11.124: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:32:11.124: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:32:11.124: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:11.124: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:32:11.124: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:11.124: INFO: Container back-off ready: false, restart count 5 Mar 24 03:32:11.124: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:11.124: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:32:11.124: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:32:11.124: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:32:11.124: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:11.124: INFO: Container back-off-cap ready: false, restart count 2 W0324 03:32:11.126607 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:32:11.195: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:11.195 (91ms) < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:32:11.196 (91ms) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:32:11.196 STEP: Destroying namespace "ephemeral-containers-test-4536" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:32:11.196 < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:32:11.198 (3ms)
Find ephemeral-containers-target-pod_ephemeral-containers-test-4536(867f5bb0-2eba-4198-a7f1-3722792ec05a) mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swith\ssubdomain\sfield\shas\sFQDN\,\shostname\sis\sshortname$'
[FAILED] failed to get logs from hostfqdn-202491 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-7107/pods/hostfqdn-202491/log?container=test-container&previous=false": stream error: stream ID 715; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:32:01.249from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:31:59.218 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:31:59.218 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 03:31:59.218 Mar 24 03:31:59.221: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:31:59.221 (3ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:59.221 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:59.221 (0s) > Enter [It] a pod with subdomain field has FQDN, hostname is shortname - test/e2e_node/pod_hostnamefqdn_test.go:114 @ 03/24/23 03:31:59.221 STEP: Creating a pod to test shortname and fqdn - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:31:59.221 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:32:01.241 Mar 24 03:32:01.242: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod hostfqdn-202491 container test-container: <nil> Mar 24 03:32:01.244: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "hostfqdn-202491" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-7107/pods/hostfqdn-202491/log?container=test-container&previous=false": stream error: stream ID 715; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:32:01.244 Mar 24 03:32:01.249: INFO: Unexpected error: <*fmt.wrapError | 0xc00119bb20>: failed to get logs from hostfqdn-202491 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-7107/pods/hostfqdn-202491/log?container=test-container&previous=false": stream error: stream ID 715; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-202491 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-7107/pods/hostfqdn-202491/log?container=test-container&previous=false\": stream error: stream ID 715; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0013842a0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-7107/pods/hostfqdn-202491/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 715, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-202491 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-7107/pods/hostfqdn-202491/log?container=test-container&previous=false": stream error: stream ID 715; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:32:01.249 < Exit [It] a pod with subdomain field has FQDN, hostname is shortname - test/e2e_node/pod_hostnamefqdn_test.go:114 @ 03/24/23 03:32:01.249 (2.028s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:01.249 Mar 24 03:32:01.249: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:01.25 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:01.25 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:01.25 (0s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:32:01.25 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:01.25 STEP: Collecting events from namespace "hostfqdn-7107". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:32:01.25 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:32:01.252 Mar 24 03:32:01.252: INFO: At 2023-03-24 03:31:59 +0000 UTC - event for hostfqdn-202491: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:32:01.252: INFO: At 2023-03-24 03:31:59 +0000 UTC - event for hostfqdn-202491: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 03:32:01.252: INFO: At 2023-03-24 03:31:59 +0000 UTC - event for hostfqdn-202491: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 03:32:01.253: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:32:01.253: INFO: Mar 24 03:32:01.254: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:01.257: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:32:01.257: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:01.258: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:01.261: INFO: server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3 started at 2023-03-24 03:31:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.261: INFO: Container srv ready: true, restart count 0 Mar 24 03:32:01.261: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:01.261: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:32:01.261: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:32:01.261: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:32:01.261: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.261: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:32:01.261: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.261: INFO: Container back-off-cap ready: true, restart count 2 Mar 24 03:32:01.261: INFO: pod-1043ad48-f014-4cbc-b931-da6525d29eb6 started at 2023-03-24 03:32:01 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.261: INFO: Container test-container ready: false, restart count 0 Mar 24 03:32:01.261: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.261: INFO: Container back-off ready: false, restart count 5 Mar 24 03:32:01.261: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:01.261: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:32:01.261: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:32:01.261: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:32:01.261: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.261: INFO: Container client-container ready: true, restart count 0 W0324 03:32:01.262903 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:32:01.340: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:01.34 (89ms) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:32:01.34 (89ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:32:01.34 STEP: Destroying namespace "hostfqdn-7107" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:32:01.34 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:32:01.342 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swith\ssubdomain\sfield\shas\sFQDN\,\swhen\ssetHostnameAsFQDN\sis\sset\sto\strue\,\sthe\sFQDN\sis\sset\sas\shostname$'
[FAILED] failed to get logs from hostfqdn-133998 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5227/pods/hostfqdn-133998/log?container=test-container&previous=false": stream error: stream ID 1437; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:58.548from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:34:54.511 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:34:54.511 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 03:34:54.511 Mar 24 03:34:54.514: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:34:54.514 (4ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:54.514 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:54.514 (0s) > Enter [It] a pod with subdomain field has FQDN, when setHostnameAsFQDN is set to true, the FQDN is set as hostname - test/e2e_node/pod_hostnamefqdn_test.go:133 @ 03/24/23 03:34:54.514 STEP: Creating a pod to test fqdn and fqdn - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:34:54.514 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:34:58.54 Mar 24 03:34:58.541: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod hostfqdn-133998 container test-container: <nil> Mar 24 03:34:58.543: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "hostfqdn-133998" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5227/pods/hostfqdn-133998/log?container=test-container&previous=false": stream error: stream ID 1437; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:34:58.543 Mar 24 03:34:58.548: INFO: Unexpected error: <*fmt.wrapError | 0xc0011158c0>: failed to get logs from hostfqdn-133998 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5227/pods/hostfqdn-133998/log?container=test-container&previous=false": stream error: stream ID 1437; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-133998 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5227/pods/hostfqdn-133998/log?container=test-container&previous=false\": stream error: stream ID 1437; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0010a2ae0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5227/pods/hostfqdn-133998/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 1437, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-133998 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5227/pods/hostfqdn-133998/log?container=test-container&previous=false": stream error: stream ID 1437; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:58.548 < Exit [It] a pod with subdomain field has FQDN, when setHostnameAsFQDN is set to true, the FQDN is set as hostname - test/e2e_node/pod_hostnamefqdn_test.go:133 @ 03/24/23 03:34:58.548 (4.034s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:58.548 Mar 24 03:34:58.548: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:58.55 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:58.55 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:58.55 (0s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:34:58.55 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:58.55 STEP: Collecting events from namespace "hostfqdn-5227". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:34:58.55 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:34:58.551 Mar 24 03:34:58.551: INFO: At 2023-03-24 03:34:55 +0000 UTC - event for hostfqdn-133998: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:34:58.551: INFO: At 2023-03-24 03:34:55 +0000 UTC - event for hostfqdn-133998: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 03:34:58.551: INFO: At 2023-03-24 03:34:55 +0000 UTC - event for hostfqdn-133998: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 03:34:58.552: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:34:58.552: INFO: Mar 24 03:34:58.553: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:58.554: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:34:58.554: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:58.555: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:58.558: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:58.558: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:34:58.558: INFO: graceful-pod-09fdf188-1017-48de-b829-336fd87bd5f5-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at <nil> (0+0 container statuses recorded) Mar 24 03:34:58.558: INFO: pod-ready started at 2023-03-24 03:34:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:58.558: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 24 03:34:58.558: INFO: busybox-526b8029-de36-4e8b-8faa-23e962a43443 started at 2023-03-24 03:34:34 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:58.558: INFO: Container busybox ready: true, restart count 0 Mar 24 03:34:58.558: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:34:58.558: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:34:58.558: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:34:58.558: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:34:58.558: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:58.558: INFO: Container back-off-cap ready: false, restart count 5 Mar 24 03:34:58.558: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:58.558: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:58.558: INFO: alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 started at 2023-03-24 03:34:48 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:58.558: INFO: Container alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 ready: false, restart count 0 Mar 24 03:34:58.558: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:58.558: INFO: Container client-container ready: true, restart count 0 W0324 03:34:58.559774 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:35:00.735: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:00.735 (2.186s) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:35:00.735 (2.186s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:35:00.735 STEP: Destroying namespace "hostfqdn-5227" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:35:00.735 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:35:00.737 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swithout\sFQDN\sis\snot\saffected\sby\sSetHostnameAsFQDN\sfield$'
[FAILED] failed to get logs from hostfqdn-117466 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1625/pods/hostfqdn-117466/log?container=test-container&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:00.365from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:24:56.285 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:24:56.285 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 03:24:56.285 Mar 24 03:24:56.297: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:24:56.297 (11ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:56.297 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:56.297 (0s) > Enter [It] a pod without FQDN is not affected by SetHostnameAsFQDN field - test/e2e_node/pod_hostnamefqdn_test.go:97 @ 03/24/23 03:24:56.297 STEP: Creating a pod to test shortname only - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:24:56.297 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:25:00.34 Mar 24 03:25:00.343: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod hostfqdn-117466 container test-container: <nil> Mar 24 03:25:00.346: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "hostfqdn-117466" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1625/pods/hostfqdn-117466/log?container=test-container&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:25:00.346 Mar 24 03:25:00.365: INFO: Unexpected error: <*fmt.wrapError | 0xc000219a40>: failed to get logs from hostfqdn-117466 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1625/pods/hostfqdn-117466/log?container=test-container&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-117466 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1625/pods/hostfqdn-117466/log?container=test-container&previous=false\": stream error: stream ID 61; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000c60480>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1625/pods/hostfqdn-117466/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 61, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-117466 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1625/pods/hostfqdn-117466/log?container=test-container&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:00.365 < Exit [It] a pod without FQDN is not affected by SetHostnameAsFQDN field - test/e2e_node/pod_hostnamefqdn_test.go:97 @ 03/24/23 03:25:00.365 (4.069s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:00.365 Mar 24 03:25:00.366: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:00.368 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:00.368 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:00.368 (0s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:25:00.368 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:00.368 STEP: Collecting events from namespace "hostfqdn-1625". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:25:00.368 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:25:00.37 Mar 24 03:25:00.370: INFO: At 2023-03-24 03:24:58 +0000 UTC - event for hostfqdn-117466: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:25:00.370: INFO: At 2023-03-24 03:24:58 +0000 UTC - event for hostfqdn-117466: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 03:25:00.370: INFO: At 2023-03-24 03:24:58 +0000 UTC - event for hostfqdn-117466: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 03:25:00.371: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:25:00.371: INFO: Mar 24 03:25:00.372: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:00.375: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 87 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:24:35 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:25:00.375: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:00.376: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:00.389: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:25:00.389: INFO: deleted-running-always-90feef0f-a69d-460a-8c0d-64a4e4a7d468 started at 2023-03-24 03:24:56 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container deleted-running-always-90feef0f-a69d-460a-8c0d-64a4e4a7d468 ready: true, restart count 0 Mar 24 03:25:00.389: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:25:00.389: INFO: bin-false3e466448-7159-4ff0-a0ef-2e816773f181 started at 2023-03-24 03:24:52 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container bin-false3e466448-7159-4ff0-a0ef-2e816773f181 ready: false, restart count 0 Mar 24 03:25:00.389: INFO: pod4de0331e-bffe-45e2-a97c-2f859267c7b5 started at 2023-03-24 03:24:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container container97e58f20-a54f-4517-80f4-325922e7a70d ready: false, restart count 0 Mar 24 03:25:00.389: INFO: deleted-running-never-ae315f44-f8cc-496c-8ea5-f0800c2014c2 started at 2023-03-24 03:24:52 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container deleted-running-never-ae315f44-f8cc-496c-8ea5-f0800c2014c2 ready: true, restart count 0 Mar 24 03:25:00.389: INFO: pod51e69781-66dd-4938-9447-45259953fe14 started at 2023-03-24 03:24:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container container33ed3425-ff63-4dac-887a-19a0f9af1c27 ready: false, restart count 0 Mar 24 03:25:00.389: INFO: pod6f5bd6bf-669e-4188-ac53-86c3b9226a51 started at 2023-03-24 03:24:53 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:00.389: INFO: Container containerd5b9f5d2-72fb-437b-9a81-56861dff026d ready: false, restart count 0 W0324 03:25:00.390846 1191 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:25:05.780: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:05.781 (5.412s) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:25:05.781 (5.412s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:25:05.781 STEP: Destroying namespace "hostfqdn-1625" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:25:05.781 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:25:05.792 (11ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swithout\ssubdomain\sfield\sdoes\snot\shave\sFQDN$'
[FAILED] failed to get logs from hostfqdn-166104 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5766/pods/hostfqdn-166104/log?container=test-container&previous=false": stream error: stream ID 143; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:11.402from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:25:07.329 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:07.329 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:07.33 Mar 24 03:25:07.346: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:25:07.346 (17ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:07.346 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:07.346 (0s) > Enter [It] a pod without subdomain field does not have FQDN - test/e2e_node/pod_hostnamefqdn_test.go:83 @ 03/24/23 03:25:07.346 STEP: Creating a pod to test shortname only - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:25:07.346 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:25:11.394 Mar 24 03:25:11.395: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod hostfqdn-166104 container test-container: <nil> Mar 24 03:25:11.397: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "hostfqdn-166104" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5766/pods/hostfqdn-166104/log?container=test-container&previous=false": stream error: stream ID 143; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:25:11.397 Mar 24 03:25:11.402: INFO: Unexpected error: <*fmt.wrapError | 0xc000564020>: failed to get logs from hostfqdn-166104 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5766/pods/hostfqdn-166104/log?container=test-container&previous=false": stream error: stream ID 143; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-166104 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5766/pods/hostfqdn-166104/log?container=test-container&previous=false\": stream error: stream ID 143; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001197d10>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5766/pods/hostfqdn-166104/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 143, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-166104 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5766/pods/hostfqdn-166104/log?container=test-container&previous=false": stream error: stream ID 143; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:11.402 < Exit [It] a pod without subdomain field does not have FQDN - test/e2e_node/pod_hostnamefqdn_test.go:83 @ 03/24/23 03:25:11.402 (4.056s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:11.402 Mar 24 03:25:11.402: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:11.404 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:11.404 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:11.404 (0s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:25:11.404 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:11.404 STEP: Collecting events from namespace "hostfqdn-5766". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:25:11.404 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:25:11.405 Mar 24 03:25:11.405: INFO: At 2023-03-24 03:25:08 +0000 UTC - event for hostfqdn-166104: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:25:11.405: INFO: At 2023-03-24 03:25:08 +0000 UTC - event for hostfqdn-166104: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 03:25:11.405: INFO: At 2023-03-24 03:25:08 +0000 UTC - event for hostfqdn-166104: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 03:25:11.406: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:25:11.406: INFO: Mar 24 03:25:11.407: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:11.408: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:25:11.409: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:11.410: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:11.413: INFO: pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:25:11.413: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:25:11.413: INFO: stats-busybox-0 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container busybox-container ready: false, restart count 0 Mar 24 03:25:11.413: INFO: log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 ready: false, restart count 0 Mar 24 03:25:11.413: INFO: pod51e69781-66dd-4938-9447-45259953fe14 started at 2023-03-24 03:24:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container container33ed3425-ff63-4dac-887a-19a0f9af1c27 ready: false, restart count 0 Mar 24 03:25:11.413: INFO: stats-busybox-1 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container busybox-container ready: false, restart count 0 Mar 24 03:25:11.413: INFO: pod-host-path-test started at 2023-03-24 03:25:08 +0000 UTC (0+2 container statuses recorded) Mar 24 03:25:11.413: INFO: Container test-container-1 ready: false, restart count 0 Mar 24 03:25:11.413: INFO: Container test-container-2 ready: false, restart count 0 Mar 24 03:25:11.413: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:25:11.413: INFO: log-pod-d96fc004-0636-46ba-8b56-a0669d739721 started at 2023-03-24 03:25:01 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container logger ready: false, restart count 0 Mar 24 03:25:11.413: INFO: pod59544fef-132c-48a4-9c23-f2fab7a12d65 started at 2023-03-24 03:25:03 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.413: INFO: Container container5663a1ff-e6c4-4622-bf3e-1e564e4823dd ready: false, restart count 0 W0324 03:25:11.414788 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:25:12.043: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:12.043 (639ms) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:25:12.043 (639ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:25:12.043 STEP: Destroying namespace "hostfqdn-5766" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:25:12.043 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:25:12.049 (6ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\sa\sbusybox\scommand\sin\sa\spod\sshould\sprint\sthe\soutput\sto\slogs\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 60.000s. Expected <string>: to equal <string>: Hello World\n In [It] at: test/e2e/common/node/kubelet.go:79 @ 03/24/23 03:36:43.415from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 03:35:41.382 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:35:41.382 STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:35:41.383 Mar 24 03:35:41.386: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 03:35:41.386 (4ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:41.386 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:41.386 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 03:35:41.386 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 03:35:41.386 (0s) > Enter [It] should print the output to logs [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:52 @ 03/24/23 03:35:41.386 [FAILED] Timed out after 60.000s. Expected <string>: to equal <string>: Hello World\n In [It] at: test/e2e/common/node/kubelet.go:79 @ 03/24/23 03:36:43.415 < Exit [It] should print the output to logs [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:52 @ 03/24/23 03:36:43.415 (1m2.029s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:36:43.415 Mar 24 03:36:43.416: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:36:43.417 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:36:43.417 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:36:43.417 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 03:36:43.417 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:36:43.417 STEP: Collecting events from namespace "kubelet-test-9746". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:36:43.418 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:36:43.419 Mar 24 03:36:43.419: INFO: At 2023-03-24 03:35:42 +0000 UTC - event for busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:36:43.419: INFO: At 2023-03-24 03:35:42 +0000 UTC - event for busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 Mar 24 03:36:43.419: INFO: At 2023-03-24 03:35:42 +0000 UTC - event for busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 Mar 24 03:36:43.420: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:36:43.420: INFO: busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:41 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:42 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:42 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:41 +0000 UTC }] Mar 24 03:36:43.420: INFO: Mar 24 03:36:43.422: INFO: Unable to fetch kubelet-test-9746/busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721/busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-9746/pods/busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721/log?container=busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721&previous=false&tailLines=42": stream error: stream ID 1591; INTERNAL_ERROR; received from peer Mar 24 03:36:43.423: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:36:43.424: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 4189 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:35:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:36:43.425: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:36:43.425: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:36:43.429: INFO: pod-handle-http-request started at 2023-03-24 03:36:01 +0000 UTC (0+2 container statuses recorded) Mar 24 03:36:43.429: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:36:43.429: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:36:43.429: INFO: busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 started at 2023-03-24 03:35:41 +0000 UTC (0+1 container statuses recorded) Mar 24 03:36:43.429: INFO: Container busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 ready: true, restart count 0 Mar 24 03:36:43.429: INFO: pod-with-poststart-exec-hook started at 2023-03-24 03:36:03 +0000 UTC (0+1 container statuses recorded) Mar 24 03:36:43.429: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 03:36:43.429: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:36:43.429: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:36:43.429: INFO: busybox-696c64ee-ea1f-4be2-9067-efac85b4cc5c started at 2023-03-24 03:35:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:36:43.429: INFO: Container busybox ready: true, restart count 0 Mar 24 03:36:43.429: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:36:43.429: INFO: Container back-off-cap ready: false, restart count 5 Mar 24 03:36:43.429: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:36:43.429: INFO: Container client-container ready: false, restart count 0 Mar 24 03:36:43.429: INFO: pod-projected-configmaps-39d603fc-c96f-4df3-b9d0-3cf94f758944 started at 2023-03-24 03:35:44 +0000 UTC (0+1 container statuses recorded) Mar 24 03:36:43.429: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:36:43.429: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:36:43.429: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:36:43.429: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:36:43.429: INFO: Container upds-volume-test ready: true, restart count 0 W0324 03:36:43.430528 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:36:43.476: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:36:43.476 (59ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 03:36:43.476 (59ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 03:36:43.476 STEP: Destroying namespace "kubelet-test-9746" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:36:43.476 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 03:36:43.479 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\sa\sread\sonly\sbusybox\scontainer\sshould\snot\swrite\sto\sroot\sfilesystem\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 60.001s. Expected <string>: to equal <string>: /bin/sh: can't create /file: Read-only file system\n In [It] at: test/e2e/common/node/kubelet.go:214 @ 03/24/23 03:27:17.652from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 03:26:15.61 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:26:15.611 STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:26:15.611 Mar 24 03:26:15.614: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 03:26:15.614 (3ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:26:15.614 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:26:15.614 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 03:26:15.614 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 03:26:15.614 (0s) > Enter [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:184 @ 03/24/23 03:26:15.614 [FAILED] Timed out after 60.001s. Expected <string>: to equal <string>: /bin/sh: can't create /file: Read-only file system\n In [It] at: test/e2e/common/node/kubelet.go:214 @ 03/24/23 03:27:17.652 < Exit [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:184 @ 03/24/23 03:27:17.652 (1m2.038s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:27:17.652 Mar 24 03:27:17.652: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:27:17.654 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:27:17.654 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:27:17.654 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 03:27:17.654 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:27:17.654 STEP: Collecting events from namespace "kubelet-test-7797". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:27:17.654 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:27:17.656 Mar 24 03:27:17.656: INFO: At 2023-03-24 03:26:16 +0000 UTC - event for busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:27:17.656: INFO: At 2023-03-24 03:26:16 +0000 UTC - event for busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 Mar 24 03:27:17.656: INFO: At 2023-03-24 03:26:16 +0000 UTC - event for busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 Mar 24 03:27:17.657: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:27:17.657: INFO: busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:15 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:16 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:16 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:15 +0000 UTC }] Mar 24 03:27:17.657: INFO: Mar 24 03:27:17.659: INFO: Unable to fetch kubelet-test-7797/busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78/busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-7797/pods/busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78/log?container=busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78&previous=false&tailLines=42": stream error: stream ID 251; INTERNAL_ERROR; received from peer Mar 24 03:27:17.660: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:17.661: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:27:17.662: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:17.663: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:17.667: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:27:17.667: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:27:17.667: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:27:17.667: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:27:17.667: INFO: pod-handle-http-request started at 2023-03-24 03:25:37 +0000 UTC (0+2 container statuses recorded) Mar 24 03:27:17.667: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:27:17.667: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:27:17.667: INFO: busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 started at 2023-03-24 03:26:15 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:17.667: INFO: Container busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 ready: true, restart count 0 Mar 24 03:27:17.667: INFO: pod-handle-http-request started at 2023-03-24 03:26:23 +0000 UTC (0+2 container statuses recorded) Mar 24 03:27:17.667: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:27:17.667: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:27:17.667: INFO: pod-with-poststart-http-hook started at 2023-03-24 03:26:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:17.667: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 03:27:17.667: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:17.667: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:27:17.667: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:17.667: INFO: Container back-off ready: false, restart count 1 Mar 24 03:27:17.667: INFO: pod-with-poststart-https-hook started at 2023-03-24 03:25:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:17.667: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 Mar 24 03:27:17.667: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:17.667: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:27:17.667: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:17.667: INFO: Container client-container ready: true, restart count 0 W0324 03:27:17.668053 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:27:17.748: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:27:17.748 (94ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 03:27:17.748 (94ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 03:27:17.748 STEP: Destroying namespace "kubelet-test-7797" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:27:17.748 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 03:27:17.75 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\san\sagnhost\sPod\swith\shostAliases\sshould\swrite\sentries\sto\s\/etc\/hosts\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-2415/pods/agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3/log": stream error: stream ID 141; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/kubelet.go:165 @ 03/24/23 03:25:22.454from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 03:25:18.364 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:18.365 STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:18.365 Mar 24 03:25:18.370: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 03:25:18.37 (6ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:18.37 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:18.37 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 03:25:18.37 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 03:25:18.37 (0s) > Enter [It] should write entries to /etc/hosts [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:148 @ 03/24/23 03:25:18.37 STEP: Waiting for pod completion - test/e2e/common/node/kubelet.go:160 @ 03/24/23 03:25:18.389 Mar 24 03:25:22.454: INFO: Unexpected error: <*url.Error | 0xc00121c2d0>: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-2415/pods/agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3/log": stream error: stream ID 141; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-2415/pods/agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3/log", Err: <http2.StreamError>{ StreamID: 141, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-2415/pods/agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3/log": stream error: stream ID 141; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/kubelet.go:165 @ 03/24/23 03:25:22.454 < Exit [It] should write entries to /etc/hosts [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:148 @ 03/24/23 03:25:22.454 (4.084s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:22.454 Mar 24 03:25:22.454: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:22.456 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:22.456 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:22.456 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 03:25:22.456 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:22.456 STEP: Collecting events from namespace "kubelet-test-2415". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:25:22.456 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:25:22.457 Mar 24 03:25:22.457: INFO: At 2023-03-24 03:25:20 +0000 UTC - event for agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:25:22.457: INFO: At 2023-03-24 03:25:20 +0000 UTC - event for agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:25:22.457: INFO: At 2023-03-24 03:25:20 +0000 UTC - event for agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:25:22.458: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:25:22.458: INFO: agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC }] Mar 24 03:25:22.459: INFO: Mar 24 03:25:22.460: INFO: Unable to fetch kubelet-test-2415/agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-2415/pods/agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 149; INTERNAL_ERROR; received from peer Mar 24 03:25:22.462: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:22.463: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:25:22.463: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:22.464: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:22.468: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:25:22.468: INFO: stats-busybox-0 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container busybox-container ready: true, restart count 1 Mar 24 03:25:22.468: INFO: busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 started at 2023-03-24 03:25:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 ready: false, restart count 0 Mar 24 03:25:22.468: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:25:22.468: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:25:22.468: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:25:22.468: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:25:22.468: INFO: static-pod-241cfed5-b7d6-4ac9-b2ab-cf3fcfa4faac-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:25:15 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container test ready: false, restart count 0 Mar 24 03:25:22.468: INFO: pod-projected-configmaps-8b0edd77-7b92-4d5f-b748-faa310a57017 started at 2023-03-24 03:25:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:25:22.468: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:25:22.468: INFO: agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3 started at 2023-03-24 03:25:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:25:22.468: INFO: stats-busybox-1 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.468: INFO: Container busybox-container ready: true, restart count 1 W0324 03:25:22.469382 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:25:24.662: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:24.662 (2.206s) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 03:25:24.662 (2.206s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 03:25:24.662 STEP: Destroying namespace "kubelet-test-2415" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:25:24.662 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 03:25:24.672 (10ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sPods\sshould\scontain\senvironment\svariables\sfor\sservices\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Container should have service environment variables set Unexpected error: <*fmt.wrapError | 0xc001442680>: failed to get logs from client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 841; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 for env3cont: Get \"https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false\": stream error: stream ID 841; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0014ff9b0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false", Err: <http2.StreamError>{ StreamID: 841, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } occurred In [It] at: test/e2e/common/node/pods.go:526 @ 03/24/23 03:32:01.078from junit_cos-stable01.xml
goroutine 844 [running]: runtime/debug.Stack() /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/runtime/debug/stack.go:24 +0x65 runtime/debug.PrintStack() /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/runtime/debug/stack.go:16 +0x19 k8s.io/kubernetes/test/e2e/common/node.expectNoErrorWithRetries(0xc000a2dea0, 0x3, {0xc00092a640, 0x1, 0x1}) test/e2e/common/node/pods.go:184 +0x189 k8s.io/kubernetes/test/e2e/common/node.glob..func15.6({0x7fd6cc519058, 0xc001200960}) test/e2e/common/node/pods.go:526 +0xa85 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x5bb29c0?, 0xc001200960}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:456 +0x48 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:863 +0x98 created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:850 +0xd65 > Enter [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 03:31:46.897 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:31:46.897 STEP: Building a namespace api object, basename pods - test/e2e/framework/framework.go:250 @ 03/24/23 03:31:46.901 Mar 24 03:31:46.921: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 03:31:46.921 (24ms) > Enter [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:46.921 < Exit [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:31:46.921 (0s) > Enter [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 03:31:46.921 < Exit [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 03:31:46.921 (0s) > Enter [It] should contain environment variables for services [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:445 @ 03/24/23 03:31:46.921 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:31:53.008 Mar 24 03:31:53.009: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 container env3cont: <nil> Mar 24 03:31:53.011: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6" container "env3cont". Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 809; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:31:53.011 Mar 24 03:31:53.016: INFO: (Attempt 1 of 3) Unexpected error occurred: failed to get logs from client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 809; INTERNAL_ERROR; received from peer STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:31:57.038 Mar 24 03:31:57.039: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 container env3cont: <nil> Mar 24 03:31:57.041: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6" container "env3cont". Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 825; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:31:57.041 Mar 24 03:31:57.045: INFO: (Attempt 2 of 3) Unexpected error occurred: failed to get logs from client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 825; INTERNAL_ERROR; received from peer STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:32:01.069 Mar 24 03:32:01.071: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 container env3cont: <nil> Mar 24 03:32:01.072: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6" container "env3cont". Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 841; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:32:01.073 Mar 24 03:32:01.077: INFO: (Attempt 3 of 3) Unexpected error occurred: failed to get logs from client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 841; INTERNAL_ERROR; received from peer [FAILED] Container should have service environment variables set Unexpected error: <*fmt.wrapError | 0xc001442680>: failed to get logs from client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false": stream error: stream ID 841; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6 for env3cont: Get \"https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false\": stream error: stream ID 841; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0014ff9b0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6/log?container=env3cont&previous=false", Err: <http2.StreamError>{ StreamID: 841, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } occurred In [It] at: test/e2e/common/node/pods.go:526 @ 03/24/23 03:32:01.078 < Exit [It] should contain environment variables for services [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:445 @ 03/24/23 03:32:01.078 (14.156s) > Enter [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:01.078 Mar 24 03:32:01.078: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:01.079 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:01.079 < Exit [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:01.079 (0s) > Enter [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 03:32:01.079 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:01.079 STEP: Collecting events from namespace "pods-5026". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:32:01.079 STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:32:01.081 Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:47 +0000 UTC - event for server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:47 +0000 UTC - event for server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container srv Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:48 +0000 UTC - event for server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container srv Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:49 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:49 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container env3cont Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:49 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container env3cont Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:53 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:53 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container env3cont Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:53 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container env3cont Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:57 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:57 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container env3cont Mar 24 03:32:01.081: INFO: At 2023-03-24 03:31:57 +0000 UTC - event for client-envvars-1c4c85ee-62d6-48cc-b056-fdd2441b7da6: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container env3cont Mar 24 03:32:01.082: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:32:01.082: INFO: server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:46 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:48 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:48 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:31:46 +0000 UTC }] Mar 24 03:32:01.082: INFO: Mar 24 03:32:01.084: INFO: Unable to fetch pods-5026/server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3/srv logs: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-5026/pods/server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3/log?container=srv&previous=false&tailLines=42": stream error: stream ID 853; INTERNAL_ERROR; received from peer Mar 24 03:32:01.085: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:01.086: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:32:01.086: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:01.087: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:01.090: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.090: INFO: Container back-off ready: false, restart count 5 Mar 24 03:32:01.090: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:01.090: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:32:01.090: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:32:01.090: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:32:01.090: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.090: INFO: Container back-off-cap ready: true, restart count 2 Mar 24 03:32:01.090: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.090: INFO: Container client-container ready: true, restart count 0 Mar 24 03:32:01.090: INFO: server-envvars-971643fd-1d5a-4705-a600-4fa07dc776d3 started at 2023-03-24 03:31:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.090: INFO: Container srv ready: true, restart count 0 Mar 24 03:32:01.090: INFO: hostfqdn-202491 started at 2023-03-24 03:31:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.090: INFO: Container test-container ready: false, restart count 0 Mar 24 03:32:01.090: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:01.090: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:32:01.090: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:32:01.090: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:32:01.090: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:01.090: INFO: Container agnhost-container ready: true, restart count 0 W0324 03:32:01.091770 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:32:01.143: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:01.143 (63ms) < Exit [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 03:32:01.143 (64ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 03:32:01.143 STEP: Destroying namespace "pods-5026" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:32:01.143 < Exit [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 03:32:01.145 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sPods\sshould\ssupport\sretrieving\slogs\sfrom\sthe\scontainer\sover\swebsockets\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Failed to open websocket to wss://127.0.0.1:6443/api/v1/namespaces/pods-3562/pods/pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f/log?container=main: websocket.Dial wss://127.0.0.1:6443/api/v1/namespaces/pods-3562/pods/pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f/log?container=main: unexpected EOF In [It] at: test/e2e/common/node/pods.go:654 @ 03/24/23 03:35:47.545from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 03:35:45.493 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:35:45.493 STEP: Building a namespace api object, basename pods - test/e2e/framework/framework.go:250 @ 03/24/23 03:35:45.493 Mar 24 03:35:45.496: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 03:35:45.496 (3ms) > Enter [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:45.496 < Exit [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:45.496 (0s) > Enter [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 03:35:45.496 < Exit [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 03:35:45.496 (0s) > Enter [It] should support retrieving logs from the container over websockets [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:619 @ 03/24/23 03:35:45.496 STEP: creating the pod - test/e2e/common/node/pods.go:623 @ 03/24/23 03:35:45.496 STEP: submitting the pod to kubernetes - test/e2e/common/node/pods.go:640 @ 03/24/23 03:35:45.496 [FAILED] Failed to open websocket to wss://127.0.0.1:6443/api/v1/namespaces/pods-3562/pods/pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f/log?container=main: websocket.Dial wss://127.0.0.1:6443/api/v1/namespaces/pods-3562/pods/pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f/log?container=main: unexpected EOF In [It] at: test/e2e/common/node/pods.go:654 @ 03/24/23 03:35:47.545 < Exit [It] should support retrieving logs from the container over websockets [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:619 @ 03/24/23 03:35:47.545 (2.049s) > Enter [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:47.545 Mar 24 03:35:47.545: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:47.547 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:47.547 < Exit [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:47.547 (0s) > Enter [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 03:35:47.547 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:47.547 STEP: Collecting events from namespace "pods-3562". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:35:47.547 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:35:47.548 Mar 24 03:35:47.548: INFO: At 2023-03-24 03:35:45 +0000 UTC - event for pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:35:47.548: INFO: At 2023-03-24 03:35:45 +0000 UTC - event for pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container main Mar 24 03:35:47.548: INFO: At 2023-03-24 03:35:46 +0000 UTC - event for pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container main Mar 24 03:35:47.549: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:35:47.549: INFO: pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:45 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:46 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:46 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:45 +0000 UTC }] Mar 24 03:35:47.549: INFO: Mar 24 03:35:47.551: INFO: Unable to fetch pods-3562/pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f/main logs: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-3562/pods/pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f/log?container=main&previous=false&tailLines=42": stream error: stream ID 2117; INTERNAL_ERROR; received from peer Mar 24 03:35:47.552: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:47.553: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 4189 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:35:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:35:47.555: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:47.558: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:47.566: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:35:47.566: INFO: busybox-696c64ee-ea1f-4be2-9067-efac85b4cc5c started at 2023-03-24 03:35:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container busybox ready: true, restart count 0 Mar 24 03:35:47.566: INFO: pod-logs-websocket-505f2797-7c68-47f6-9846-1407669def0f started at 2023-03-24 03:35:45 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container main ready: true, restart count 0 Mar 24 03:35:47.566: INFO: pod-projected-configmaps-39d603fc-c96f-4df3-b9d0-3cf94f758944 started at 2023-03-24 03:35:44 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:35:47.566: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:35:47.566: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:35:47.566: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:35:47.566: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:35:47.566: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container back-off-cap ready: false, restart count 5 Mar 24 03:35:47.566: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container client-container ready: true, restart count 0 Mar 24 03:35:47.566: INFO: pod-exec-websocket-3dd9f1e0-7e4a-4e6a-aaad-3031d37ad42d started at 2023-03-24 03:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container main ready: true, restart count 0 Mar 24 03:35:47.566: INFO: busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 started at 2023-03-24 03:35:41 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:47.566: INFO: Container busybox-scheduling-ad927ce9-f0f5-437a-82ed-0059a225e721 ready: true, restart count 0 W0324 03:35:47.567802 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:35:47.627: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:47.627 (80ms) < Exit [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 03:35:47.627 (80ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 03:35:47.627 STEP: Destroying namespace "pods-3562" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:35:47.627 < Exit [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 03:35:47.629 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecrets\sshould\sbe\sconsumable\sfrom\spods\sin\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa for secret-env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-4018/pods/pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa/log?container=secret-env-test&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:24:50.584from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 03:24:46.527 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:24:46.527 STEP: Building a namespace api object, basename secrets - test/e2e/framework/framework.go:250 @ 03/24/23 03:24:46.528 Mar 24 03:24:46.536: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 03:24:46.536 (8ms) > Enter [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:46.536 < Exit [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:46.536 (0s) > Enter [It] should be consumable from pods in env vars [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:46 @ 03/24/23 03:24:46.536 STEP: Creating secret with name secret-test-d08d3ce8-bfa3-4895-b643-5f2e0d2a39aa - test/e2e/common/node/secrets.go:50 @ 03/24/23 03:24:46.537 STEP: Creating a pod to test consume secrets - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:24:46.54 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:24:50.566 Mar 24 03:24:50.568: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa container secret-env-test: <nil> Mar 24 03:24:50.569: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa" container "secret-env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-4018/pods/pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa/log?container=secret-env-test&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:24:50.57 Mar 24 03:24:50.583: INFO: Unexpected error: <*fmt.wrapError | 0xc000af9f00>: failed to get logs from pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa for secret-env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-4018/pods/pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa/log?container=secret-env-test&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa for secret-env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/secrets-4018/pods/pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa/log?container=secret-env-test&previous=false\": stream error: stream ID 61; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000fec660>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/secrets-4018/pods/pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa/log?container=secret-env-test&previous=false", Err: <http2.StreamError>{ StreamID: 61, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa for secret-env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-4018/pods/pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa/log?container=secret-env-test&previous=false": stream error: stream ID 61; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:24:50.584 < Exit [It] should be consumable from pods in env vars [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:46 @ 03/24/23 03:24:50.584 (4.048s) > Enter [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:24:50.584 Mar 24 03:24:50.584: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:24:50.585 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:24:50.585 < Exit [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:24:50.585 (0s) > Enter [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 03:24:50.585 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:24:50.585 STEP: Collecting events from namespace "secrets-4018". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:24:50.585 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:24:50.59 Mar 24 03:24:50.590: INFO: At 2023-03-24 03:24:48 +0000 UTC - event for pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:24:50.590: INFO: At 2023-03-24 03:24:48 +0000 UTC - event for pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container secret-env-test Mar 24 03:24:50.590: INFO: At 2023-03-24 03:24:48 +0000 UTC - event for pod-secrets-1dc75300-7d3e-4299-a262-79c1c45807aa: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container secret-env-test Mar 24 03:24:50.591: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:24:50.591: INFO: Mar 24 03:24:50.592: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:24:50.595: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 87 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:24:35 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:24:35 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:24:50.596: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:24:50.597: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:24:50.603: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:50.603: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:24:50.603: INFO: client-containers-3a2944f4-798b-403a-8847-395b9775f3e6 started at 2023-03-24 03:24:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:50.603: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:24:50.603: INFO: pod-projected-secrets-a6a9e4ad-25dd-4936-aaee-38153bfcfc50 started at 2023-03-24 03:24:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:50.603: INFO: Container projected-secret-volume-test ready: true, restart count 0 Mar 24 03:24:50.603: INFO: shared-pid-ns-test-pod started at 2023-03-24 03:24:47 +0000 UTC (0+2 container statuses recorded) Mar 24 03:24:50.603: INFO: Container test-container-1 ready: false, restart count 0 Mar 24 03:24:50.603: INFO: Container test-container-2 ready: false, restart count 0 Mar 24 03:24:50.603: INFO: pod-init-b4fd117c-c167-4e16-8573-b781a2256267 started at 2023-03-24 03:24:49 +0000 UTC (2+1 container statuses recorded) Mar 24 03:24:50.603: INFO: Init container init1 ready: false, restart count 0 Mar 24 03:24:50.603: INFO: Init container init2 ready: false, restart count 0 Mar 24 03:24:50.603: INFO: Container run1 ready: false, restart count 0 Mar 24 03:24:50.603: INFO: deleted-running-never-812f9f96-5cdf-400a-b555-1ec1584e4f0f started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:50.603: INFO: Container deleted-running-never-812f9f96-5cdf-400a-b555-1ec1584e4f0f ready: false, restart count 0 Mar 24 03:24:50.603: INFO: poda331cd66-046f-46c8-8592-61ff8fe83dda started at 2023-03-24 03:24:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:50.603: INFO: Container containere4b76138-7a38-409c-aa4d-52090292f485 ready: false, restart count 0 Mar 24 03:24:50.603: INFO: podbac21578-6bed-40a3-bf09-d1aa5102fb05 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:24:50.603: INFO: Container container684a39a7-a3af-47b6-b26f-a1d4becb581d ready: false, restart count 0 W0324 03:24:50.606155 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:24:53.103: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:24:53.103 (2.518s) < Exit [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 03:24:53.103 (2.518s) > Enter [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 03:24:53.103 STEP: Destroying namespace "secrets-4018" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:24:53.103 < Exit [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 03:24:53.11 (6ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecrets\sshould\sbe\sconsumable\svia\sthe\senvironment\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-477/pods/pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345/log?container=env-test&previous=false": stream error: stream ID 1479; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:35:04.78from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 03:35:00.739 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:35:00.739 STEP: Building a namespace api object, basename secrets - test/e2e/framework/framework.go:250 @ 03/24/23 03:35:00.739 Mar 24 03:35:00.742: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 03:35:00.742 (3ms) > Enter [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:00.742 < Exit [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:00.742 (0s) > Enter [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:95 @ 03/24/23 03:35:00.742 STEP: creating secret secrets-477/secret-test-b2019eb2-84ee-4c89-9e3e-38c867ce3234 - test/e2e/common/node/secrets.go:98 @ 03/24/23 03:35:00.742 STEP: Creating a pod to test consume secrets - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:35:00.744 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:35:04.771 Mar 24 03:35:04.772: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345 container env-test: <nil> Mar 24 03:35:04.774: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345" container "env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-477/pods/pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345/log?container=env-test&previous=false": stream error: stream ID 1479; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:35:04.774 Mar 24 03:35:04.779: INFO: Unexpected error: <*fmt.wrapError | 0xc00187d980>: failed to get logs from pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-477/pods/pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345/log?container=env-test&previous=false": stream error: stream ID 1479; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345 for env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/secrets-477/pods/pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345/log?container=env-test&previous=false\": stream error: stream ID 1479; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000a1fe60>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/secrets-477/pods/pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 1479, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-477/pods/pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345/log?container=env-test&previous=false": stream error: stream ID 1479; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:35:04.78 < Exit [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:95 @ 03/24/23 03:35:04.78 (4.037s) > Enter [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:04.78 Mar 24 03:35:04.780: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:04.781 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:04.781 < Exit [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:04.781 (0s) > Enter [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 03:35:04.781 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:04.781 STEP: Collecting events from namespace "secrets-477". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:35:04.781 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:35:04.782 Mar 24 03:35:04.782: INFO: At 2023-03-24 03:35:01 +0000 UTC - event for pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:35:04.782: INFO: At 2023-03-24 03:35:01 +0000 UTC - event for pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container env-test Mar 24 03:35:04.782: INFO: At 2023-03-24 03:35:01 +0000 UTC - event for pod-configmaps-07ac4d61-3fc1-4fe3-b8eb-b7373a866345: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container env-test Mar 24 03:35:04.783: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:35:04.783: INFO: Mar 24 03:35:04.784: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:04.785: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:35:04.786: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:04.786: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:04.790: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:35:04.790: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:35:04.790: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:35:04.790: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:35:04.790: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:04.790: INFO: Container back-off-cap ready: false, restart count 5 Mar 24 03:35:04.790: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:04.790: INFO: Container client-container ready: true, restart count 0 Mar 24 03:35:04.790: INFO: busybox-526b8029-de36-4e8b-8faa-23e962a43443 started at 2023-03-24 03:34:34 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:04.790: INFO: Container busybox ready: true, restart count 0 Mar 24 03:35:04.790: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:04.790: INFO: Container client-container ready: true, restart count 0 Mar 24 03:35:04.790: INFO: graceful-pod-09fdf188-1017-48de-b829-336fd87bd5f5-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at <nil> (0+0 container statuses recorded) Mar 24 03:35:04.790: INFO: pod-ready started at 2023-03-24 03:34:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:04.790: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 24 03:35:04.790: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:04.790: INFO: Container agnhost-container ready: true, restart count 0 W0324 03:35:04.794847 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:35:10.075: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:10.075 (5.294s) < Exit [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 03:35:10.075 (5.294s) > Enter [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 03:35:10.075 STEP: Destroying namespace "secrets-477" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:35:10.075 < Exit [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 03:35:10.077 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\sWhen\screating\sa\spod\swith\sprivileged\sshould\srun\sthe\scontainer\sas\sunprivileged\swhen\sfalse\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] GetPodLogs for pod "busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7" failed: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-2645/pods/busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7/log?container=busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7&previous=false": stream error: stream ID 199; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/security_context.go:532 @ 03/24/23 03:25:22.595from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:25:18.526 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:18.526 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:18.526 Mar 24 03:25:18.542: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:25:18.542 (17ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:18.542 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:18.542 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:25:18.542 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:25:18.542 (0s) > Enter [It] should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:528 @ 03/24/23 03:25:18.542 [FAILED] GetPodLogs for pod "busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7" failed: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-2645/pods/busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7/log?container=busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7&previous=false": stream error: stream ID 199; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/security_context.go:532 @ 03/24/23 03:25:22.595 < Exit [It] should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:528 @ 03/24/23 03:25:22.595 (4.053s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:22.595 Mar 24 03:25:22.595: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:22.597 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:22.597 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:22.597 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:25:22.597 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:22.597 STEP: Collecting events from namespace "security-context-test-2645". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:25:22.597 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:25:22.598 Mar 24 03:25:22.598: INFO: At 2023-03-24 03:25:20 +0000 UTC - event for busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:25:22.598: INFO: At 2023-03-24 03:25:20 +0000 UTC - event for busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 Mar 24 03:25:22.598: INFO: At 2023-03-24 03:25:20 +0000 UTC - event for busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 Mar 24 03:25:22.599: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:25:22.599: INFO: busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:25:18 +0000 UTC }] Mar 24 03:25:22.599: INFO: Mar 24 03:25:22.601: INFO: Unable to fetch security-context-test-2645/busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7/busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-2645/pods/busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7/log?container=busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7&previous=false&tailLines=42": stream error: stream ID 207; INTERNAL_ERROR; received from peer Mar 24 03:25:22.602: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:22.603: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:25:22.604: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:22.605: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:22.608: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:25:22.608: INFO: stats-busybox-0 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container busybox-container ready: true, restart count 1 Mar 24 03:25:22.608: INFO: busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 started at 2023-03-24 03:25:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 ready: false, restart count 0 Mar 24 03:25:22.608: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:25:22.608: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:25:22.608: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:25:22.608: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:25:22.608: INFO: static-pod-241cfed5-b7d6-4ac9-b2ab-cf3fcfa4faac-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:25:15 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container test ready: false, restart count 0 Mar 24 03:25:22.608: INFO: pod-projected-configmaps-8b0edd77-7b92-4d5f-b748-faa310a57017 started at 2023-03-24 03:25:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:25:22.608: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:25:22.608: INFO: agnhost-host-aliases763ddb33-4946-41cb-aca8-9e433fd72bd3 started at 2023-03-24 03:25:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:25:22.608: INFO: stats-busybox-1 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:22.608: INFO: Container busybox-container ready: true, restart count 1 W0324 03:25:22.609592 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:25:24.623: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:24.623 (2.026s) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:25:24.623 (2.026s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:25:24.623 STEP: Destroying namespace "security-context-test-2645" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:25:24.623 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:25:24.633 (10ms)
Find busybox-privileged-false-336577f1-6bbe-4416-b544-7cf8c05424b7 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\swhen\screating\scontainers\swith\sAllowPrivilegeEscalation\sshould\sallow\sprivilege\sescalation\swhen\snot\sexplicitly\sset\sand\suid\s\!\=\s0\s\[LinuxOnly\]\s\[NodeConformance\]$'
[FAILED] Match output for pod "alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0" failed: failed to get output for container "alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0" of pod "alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0" In [It] at: test/e2e/common/node/security_context.go:597 @ 03/24/23 03:28:45.457from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:28:41.373 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:28:41.374 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:28:41.374 Mar 24 03:28:41.377: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:28:41.377 (3ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:41.377 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:41.377 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:28:41.377 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:28:41.377 (0s) > Enter [It] should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:594 @ 03/24/23 03:28:41.377 [FAILED] Match output for pod "alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0" failed: failed to get output for container "alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0" of pod "alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0" In [It] at: test/e2e/common/node/security_context.go:597 @ 03/24/23 03:28:45.457 < Exit [It] should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:594 @ 03/24/23 03:28:45.457 (4.081s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:45.457 Mar 24 03:28:45.457: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:45.459 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:45.459 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:45.459 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:28:45.459 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:45.459 STEP: Collecting events from namespace "security-context-test-8375". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:28:45.459 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:28:45.46 Mar 24 03:28:45.460: INFO: At 2023-03-24 03:28:41 +0000 UTC - event for alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/nonewprivs:1.3" already present on machine Mar 24 03:28:45.460: INFO: At 2023-03-24 03:28:42 +0000 UTC - event for alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0 Mar 24 03:28:45.460: INFO: At 2023-03-24 03:28:42 +0000 UTC - event for alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0 Mar 24 03:28:45.461: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:28:45.461: INFO: alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:41 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:41 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:41 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:41 +0000 UTC }] Mar 24 03:28:45.461: INFO: Mar 24 03:28:45.463: INFO: Unable to fetch security-context-test-8375/alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0/alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-8375/pods/alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0/log?container=alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0&previous=false&tailLines=42": stream error: stream ID 927; INTERNAL_ERROR; received from peer Mar 24 03:28:45.464: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:45.466: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:28:45.466: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:45.467: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:45.470: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:28:45.470: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:28:45.470: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:28:45.470: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:28:45.470: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:45.470: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:28:45.470: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:28:45.470: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:45.470: INFO: Container back-off ready: true, restart count 4 Mar 24 03:28:45.470: INFO: container-must-be-restarted started at 2023-03-24 03:28:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:45.470: INFO: Container regular-1 ready: false, restart count 1 Mar 24 03:28:45.470: INFO: alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0 started at 2023-03-24 03:28:41 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:45.470: INFO: Container alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0 ready: false, restart count 0 Mar 24 03:28:45.470: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:45.470: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:28:45.470: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:45.470: INFO: Container client-container ready: false, restart count 0 Mar 24 03:28:45.470: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:45.470: INFO: Container agnhost ready: true, restart count 0 W0324 03:28:45.471599 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:28:45.519: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:45.519 (60ms) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:28:45.523 (64ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:28:45.523 STEP: Destroying namespace "security-context-test-8375" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:28:45.523 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:28:45.526 (3ms)
Find alpine-nnp-nil-e74b87e3-db0e-4a6f-a83c-532ea723fca0 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\swhen\screating\scontainers\swith\sAllowPrivilegeEscalation\sshould\sallow\sprivilege\sescalation\swhen\strue\s\[LinuxOnly\]\s\[NodeConformance\]$'
[FAILED] Match output for pod "alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73" failed: failed to get output for container "alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73" of pod "alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73" In [It] at: test/e2e/common/node/security_context.go:630 @ 03/24/23 03:34:52.305from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:34:48.27 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:34:48.27 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:34:48.271 Mar 24 03:34:48.276: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:34:48.276 (5ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:48.276 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:48.276 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:34:48.276 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:34:48.276 (0s) > Enter [It] should allow privilege escalation when true [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:626 @ 03/24/23 03:34:48.276 [FAILED] Match output for pod "alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73" failed: failed to get output for container "alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73" of pod "alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73" In [It] at: test/e2e/common/node/security_context.go:630 @ 03/24/23 03:34:52.305 < Exit [It] should allow privilege escalation when true [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:626 @ 03/24/23 03:34:52.305 (4.029s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:52.305 Mar 24 03:34:52.305: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:52.306 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:52.306 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:52.307 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:34:52.307 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:52.307 STEP: Collecting events from namespace "security-context-test-7615". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:34:52.307 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:34:52.308 Mar 24 03:34:52.308: INFO: At 2023-03-24 03:34:48 +0000 UTC - event for alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/nonewprivs:1.3" already present on machine Mar 24 03:34:52.308: INFO: At 2023-03-24 03:34:48 +0000 UTC - event for alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 Mar 24 03:34:52.308: INFO: At 2023-03-24 03:34:48 +0000 UTC - event for alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 Mar 24 03:34:52.309: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:34:52.309: INFO: alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:34:48 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:34:50 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:34:50 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:34:48 +0000 UTC }] Mar 24 03:34:52.309: INFO: Mar 24 03:34:52.310: INFO: Unable to fetch security-context-test-7615/alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73/alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-7615/pods/alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73/log?container=alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73&previous=false&tailLines=42": stream error: stream ID 1407; INTERNAL_ERROR; received from peer Mar 24 03:34:52.312: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:52.313: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:34:52.313: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:52.314: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:52.317: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:52.317: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:52.317: INFO: busybox-526b8029-de36-4e8b-8faa-23e962a43443 started at 2023-03-24 03:34:34 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:52.317: INFO: Container busybox ready: true, restart count 0 Mar 24 03:34:52.317: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:34:52.317: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:34:52.317: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:34:52.317: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:34:52.317: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:52.317: INFO: Container back-off-cap ready: true, restart count 5 Mar 24 03:34:52.317: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:52.317: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:52.317: INFO: alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 started at 2023-03-24 03:34:48 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:52.317: INFO: Container alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 ready: false, restart count 0 Mar 24 03:34:52.317: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:52.317: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:34:52.317: INFO: graceful-pod-09fdf188-1017-48de-b829-336fd87bd5f5-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at <nil> (0+0 container statuses recorded) Mar 24 03:34:52.317: INFO: pod-ready started at 2023-03-24 03:34:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:52.317: INFO: Container pod-readiness-gate ready: true, restart count 0 W0324 03:34:52.318839 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:34:54.505: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:54.505 (2.199s) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:34:54.505 (2.199s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:34:54.505 STEP: Destroying namespace "security-context-test-7615" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:34:54.506 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:34:54.509 (3ms)
Find alpine-nnp-true-c22fb263-1176-4e0a-be50-013f248f5e73 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\swhen\screating\scontainers\swith\sAllowPrivilegeEscalation\sshould\snot\sallow\sprivilege\sescalation\swhen\sfalse\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Match output for pod "alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421" failed: failed to get output for container "alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421" of pod "alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421" In [It] at: test/e2e/common/node/security_context.go:613 @ 03/24/23 03:35:40.063from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:35:36.027 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:35:36.027 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 03:35:36.027 Mar 24 03:35:36.032: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 03:35:36.032 (5ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:36.032 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:36.032 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:35:36.032 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 03:35:36.032 (0s) > Enter [It] should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:609 @ 03/24/23 03:35:36.032 [FAILED] Match output for pod "alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421" failed: failed to get output for container "alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421" of pod "alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421" In [It] at: test/e2e/common/node/security_context.go:613 @ 03/24/23 03:35:40.063 < Exit [It] should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:609 @ 03/24/23 03:35:40.063 (4.03s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:40.063 Mar 24 03:35:40.063: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:40.064 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:40.064 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:40.064 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:35:40.064 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:40.064 STEP: Collecting events from namespace "security-context-test-4092". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:35:40.064 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:35:40.065 Mar 24 03:35:40.065: INFO: At 2023-03-24 03:35:37 +0000 UTC - event for alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/nonewprivs:1.3" already present on machine Mar 24 03:35:40.065: INFO: At 2023-03-24 03:35:37 +0000 UTC - event for alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421 Mar 24 03:35:40.065: INFO: At 2023-03-24 03:35:38 +0000 UTC - event for alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421 Mar 24 03:35:40.067: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:35:40.067: INFO: alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:36 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:36 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:36 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:35:36 +0000 UTC }] Mar 24 03:35:40.067: INFO: Mar 24 03:35:40.068: INFO: Unable to fetch security-context-test-4092/alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421/alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-4092/pods/alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421/log?container=alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421&previous=false&tailLines=42": stream error: stream ID 2041; INTERNAL_ERROR; received from peer Mar 24 03:35:40.070: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:40.071: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 4189 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:35:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:35:40.071: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:40.072: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:40.075: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:35:40.075: INFO: busybox-696c64ee-ea1f-4be2-9067-efac85b4cc5c started at 2023-03-24 03:35:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container busybox ready: true, restart count 0 Mar 24 03:35:40.075: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:35:40.075: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:35:40.075: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:35:40.075: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:35:40.075: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container back-off-cap ready: false, restart count 5 Mar 24 03:35:40.075: INFO: alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421 started at 2023-03-24 03:35:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421 ready: false, restart count 0 Mar 24 03:35:40.075: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container client-container ready: true, restart count 0 Mar 24 03:35:40.075: INFO: pod-exec-websocket-3dd9f1e0-7e4a-4e6a-aaad-3031d37ad42d started at 2023-03-24 03:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container main ready: true, restart count 0 Mar 24 03:35:40.075: INFO: projected-volume-c39f59bd-9f19-4820-afd3-c7d9c08cd7ba started at 2023-03-24 03:35:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container projected-all-volume-test ready: false, restart count 0 Mar 24 03:35:40.075: INFO: pod98335297-5ef9-4c4c-a3e0-db877637f2bd started at 2023-03-24 03:35:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container container3c0a10b1-527f-414a-a032-98eeb0c8de87 ready: false, restart count 0 Mar 24 03:35:40.075: INFO: podd3968ee7-1343-4513-8ee6-7b69bb6140e1 started at 2023-03-24 03:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:40.075: INFO: Container containerc5517caa-a6e0-4230-82a2-35962c8a7cc1 ready: false, restart count 0 W0324 03:35:40.076769 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:35:41.335: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:41.335 (1.271s) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 03:35:41.335 (1.271s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:35:41.335 STEP: Destroying namespace "security-context-test-4092" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:35:41.335 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 03:35:41.34 (5ms)
Find alpine-nnp-false-8882bd8b-6236-419e-aa2c-f1ee207c5421 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSysctls\s\[LinuxOnly\]\s\[NodeConformance\]\sshould\ssupport\ssysctls\s\[MinimumKubeletVersion\:1\.21\]\s\[Conformance\]$'
[FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-4436/pods/sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98/log?container=test-container&previous=false": stream error: stream ID 391; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:111 @ 03/24/23 03:26:19.097from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 03:26:15.015 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 03:26:15.015 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:26:15.015 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:26:15.015 STEP: Building a namespace api object, basename sysctl - test/e2e/framework/framework.go:250 @ 03/24/23 03:26:15.015 Mar 24 03:26:15.018: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:26:15.018 (3ms) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:26:15.018 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:26:15.018 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 03:26:15.018 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 03:26:15.018 (0s) > Enter [It] should support sysctls [MinimumKubeletVersion:1.21] [Conformance] - test/e2e/common/node/sysctl.go:77 @ 03/24/23 03:26:15.018 STEP: Creating a pod with the kernel.shm_rmid_forced sysctl - test/e2e/common/node/sysctl.go:89 @ 03/24/23 03:26:15.018 STEP: Watching for error events or started pod - test/e2e/common/node/sysctl.go:92 @ 03/24/23 03:26:15.051 STEP: Waiting for pod completion - test/e2e/common/node/sysctl.go:100 @ 03/24/23 03:26:17.053 STEP: Checking that the pod succeeded - test/e2e/common/node/sysctl.go:106 @ 03/24/23 03:26:19.085 STEP: Getting logs from the pod - test/e2e/common/node/sysctl.go:109 @ 03/24/23 03:26:19.085 Mar 24 03:26:19.097: INFO: Unexpected error: <*url.Error | 0xc0016d2720>: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-4436/pods/sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98/log?container=test-container&previous=false": stream error: stream ID 391; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/sysctl-4436/pods/sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 391, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-4436/pods/sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98/log?container=test-container&previous=false": stream error: stream ID 391; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:111 @ 03/24/23 03:26:19.097 < Exit [It] should support sysctls [MinimumKubeletVersion:1.21] [Conformance] - test/e2e/common/node/sysctl.go:77 @ 03/24/23 03:26:19.097 (4.078s) > Enter [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:26:19.097 Mar 24 03:26:19.097: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:26:19.107 (10ms) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:26:19.107 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:26:19.107 (0s) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:26:19.107 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:26:19.107 STEP: Collecting events from namespace "sysctl-4436". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:26:19.107 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:26:19.112 Mar 24 03:26:19.112: INFO: At 2023-03-24 03:26:15 +0000 UTC - event for sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:26:19.112: INFO: At 2023-03-24 03:26:15 +0000 UTC - event for sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 03:26:19.112: INFO: At 2023-03-24 03:26:15 +0000 UTC - event for sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 03:26:19.119: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:26:19.119: INFO: sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:15 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:15 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:15 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:26:15 +0000 UTC }] Mar 24 03:26:19.119: INFO: Mar 24 03:26:19.127: INFO: Unable to fetch sysctl-4436/sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98/test-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-4436/pods/sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98/log?container=test-container&previous=false&tailLines=42": stream error: stream ID 399; INTERNAL_ERROR; received from peer Mar 24 03:26:19.135: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:26:19.143: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:26:19.143: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:26:19.148: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:26:19.159: INFO: busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 started at 2023-03-24 03:26:15 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 ready: true, restart count 0 Mar 24 03:26:19.159: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container client-container ready: true, restart count 0 Mar 24 03:26:19.159: INFO: pod-update-2aaf5786-3dfc-4264-92fe-4b1bcab9bad6 started at 2023-03-24 03:26:13 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container pause ready: true, restart count 0 Mar 24 03:26:19.159: INFO: pod-with-poststart-https-hook started at 2023-03-24 03:25:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 Mar 24 03:26:19.159: INFO: sysctl-54e0b977-5d17-4d5a-bc41-71e8d39ade98 started at 2023-03-24 03:26:15 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container test-container ready: false, restart count 0 Mar 24 03:26:19.159: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:26:19.159: INFO: stats-busybox-1 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container busybox-container ready: true, restart count 1 Mar 24 03:26:19.159: INFO: busybox-336f925c-8a13-4887-985b-23d76fe24869 started at 2023-03-24 03:25:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container busybox ready: false, restart count 0 Mar 24 03:26:19.159: INFO: test-runtimeclass-runtimeclass-7017-preconfigured-handler-h5rbv started at 2023-03-24 03:26:19 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container test ready: false, restart count 0 Mar 24 03:26:19.159: INFO: stats-busybox-0 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:26:19.159: INFO: Container busybox-container ready: true, restart count 1 Mar 24 03:26:19.159: INFO: pod-handle-http-request started at 2023-03-24 03:25:38 +0000 UTC (0+2 container statuses recorded) Mar 24 03:26:19.159: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:26:19.159: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:26:19.159: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:26:19.159: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:26:19.159: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:26:19.159: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:26:19.159: INFO: pod-handle-http-request started at 2023-03-24 03:25:37 +0000 UTC (0+2 container statuses recorded) Mar 24 03:26:19.159: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:26:19.159: INFO: Container container-handle-https-request ready: true, restart count 0 W0324 03:26:19.165898 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:26:19.318: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:26:19.318 (211ms) < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:26:19.318 (211ms) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:26:19.318 STEP: Destroying namespace "sysctl-4436" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:26:19.318 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:26:19.326 (8ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSysctls\s\[LinuxOnly\]\s\[NodeConformance\]\sshould\ssupport\ssysctls\swith\sslashes\sas\sseparator\s\[MinimumKubeletVersion\:1\.23\]$'
[FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7721/pods/sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7/log?container=test-container&previous=false": stream error: stream ID 817; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:220 @ 03/24/23 03:28:25.144from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 03:28:23.121 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 03:28:23.122 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:28:23.122 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:28:23.122 STEP: Building a namespace api object, basename sysctl - test/e2e/framework/framework.go:250 @ 03/24/23 03:28:23.122 Mar 24 03:28:23.124: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 03:28:23.124 (3ms) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:23.124 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:23.124 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 03:28:23.124 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 03:28:23.124 (0s) > Enter [It] should support sysctls with slashes as separator [MinimumKubeletVersion:1.23] - test/e2e/common/node/sysctl.go:186 @ 03/24/23 03:28:23.124 STEP: Creating a pod with the kernel/shm_rmid_forced sysctl - test/e2e/common/node/sysctl.go:198 @ 03/24/23 03:28:23.124 STEP: Watching for error events or started pod - test/e2e/common/node/sysctl.go:201 @ 03/24/23 03:28:23.137 STEP: Waiting for pod completion - test/e2e/common/node/sysctl.go:209 @ 03/24/23 03:28:25.14 STEP: Checking that the pod succeeded - test/e2e/common/node/sysctl.go:215 @ 03/24/23 03:28:25.142 STEP: Getting logs from the pod - test/e2e/common/node/sysctl.go:218 @ 03/24/23 03:28:25.142 Mar 24 03:28:25.144: INFO: Unexpected error: <*url.Error | 0xc00152f6e0>: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7721/pods/sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7/log?container=test-container&previous=false": stream error: stream ID 817; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7721/pods/sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 817, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7721/pods/sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7/log?container=test-container&previous=false": stream error: stream ID 817; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:220 @ 03/24/23 03:28:25.144 < Exit [It] should support sysctls with slashes as separator [MinimumKubeletVersion:1.23] - test/e2e/common/node/sysctl.go:186 @ 03/24/23 03:28:25.144 (2.02s) > Enter [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:25.144 Mar 24 03:28:25.144: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:25.145 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:25.145 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:25.145 (0s) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:28:25.145 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:25.145 STEP: Collecting events from namespace "sysctl-7721". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:28:25.145 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:28:25.147 Mar 24 03:28:25.147: INFO: At 2023-03-24 03:28:23 +0000 UTC - event for sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:28:25.147: INFO: At 2023-03-24 03:28:23 +0000 UTC - event for sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 03:28:25.147: INFO: At 2023-03-24 03:28:23 +0000 UTC - event for sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 03:28:25.148: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:28:25.148: INFO: sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:23 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:23 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:23 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:28:23 +0000 UTC }] Mar 24 03:28:25.148: INFO: Mar 24 03:28:25.149: INFO: Unable to fetch sysctl-7721/sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7/test-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7721/pods/sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7/log?container=test-container&previous=false&tailLines=42": stream error: stream ID 825; INTERNAL_ERROR; received from peer Mar 24 03:28:25.150: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:25.151: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:28:25.152: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:25.153: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:25.156: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:25.156: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:28:25.156: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:25.156: INFO: Container back-off ready: false, restart count 3 Mar 24 03:28:25.156: INFO: pod-handle-http-request started at 2023-03-24 03:26:23 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:25.156: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:28:25.156: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:28:25.156: INFO: pod-with-poststart-http-hook started at 2023-03-24 03:26:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:25.156: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 03:28:25.156: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:25.156: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:28:25.156: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:25.156: INFO: Container client-container ready: false, restart count 0 Mar 24 03:28:25.156: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:28:25.156: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:28:25.156: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:28:25.156: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:28:25.156: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:25.156: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:28:25.156: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:28:25.156: INFO: sysctl-aa1c7c7c-2956-470c-874d-05adffcf2bd7 started at 2023-03-24 03:28:23 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:25.156: INFO: Container test-container ready: false, restart count 0 W0324 03:28:25.157386 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:28:25.208: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:25.208 (62ms) < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 03:28:25.208 (62ms) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:28:25.208 STEP: Destroying namespace "sysctl-7721" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:28:25.208 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 03:28:25.21 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sVariable\sExpansion\sshould\sallow\scomposing\senv\svars\sinto\snew\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-7382/pods/var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4/log?container=dapi-container&previous=false": stream error: stream ID 525; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:35.517from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 03:29:31.455 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:29:31.455 STEP: Building a namespace api object, basename var-expansion - test/e2e/framework/framework.go:250 @ 03/24/23 03:29:31.455 Mar 24 03:29:31.463: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 03:29:31.463 (8ms) > Enter [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:31.463 < Exit [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:31.463 (0s) > Enter [It] should allow composing env vars into new env vars [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:47 @ 03/24/23 03:29:31.463 STEP: Creating a pod to test env composition - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:29:31.463 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:29:35.505 Mar 24 03:29:35.510: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4 container dapi-container: <nil> Mar 24 03:29:35.512: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-7382/pods/var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4/log?container=dapi-container&previous=false": stream error: stream ID 525; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:29:35.512 Mar 24 03:29:35.517: INFO: Unexpected error: <*fmt.wrapError | 0xc001392080>: failed to get logs from var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-7382/pods/var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4/log?container=dapi-container&previous=false": stream error: stream ID 525; INTERNAL_ERROR; received from peer { msg: "failed to get logs from var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/var-expansion-7382/pods/var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4/log?container=dapi-container&previous=false\": stream error: stream ID 525; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001809a40>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-7382/pods/var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 525, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-7382/pods/var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4/log?container=dapi-container&previous=false": stream error: stream ID 525; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:35.517 < Exit [It] should allow composing env vars into new env vars [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:47 @ 03/24/23 03:29:35.517 (4.054s) > Enter [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:35.517 Mar 24 03:29:35.517: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:35.518 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:35.518 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:35.518 (0s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 03:29:35.518 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:35.518 STEP: Collecting events from namespace "var-expansion-7382". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:29:35.518 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:29:35.519 Mar 24 03:29:35.519: INFO: At 2023-03-24 03:29:32 +0000 UTC - event for var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:29:35.519: INFO: At 2023-03-24 03:29:32 +0000 UTC - event for var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:29:35.519: INFO: At 2023-03-24 03:29:32 +0000 UTC - event for var-expansion-17d30f09-b928-4e36-92f5-d1aa31ec24f4: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:29:35.520: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:29:35.520: INFO: Mar 24 03:29:35.521: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:35.523: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:29:35.523: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:35.524: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:35.527: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:35.527: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:29:35.527: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:29:35.527: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:29:35.527: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:29:35.527: INFO: test-host-network-pod started at 2023-03-24 03:29:28 +0000 UTC (0+2 container statuses recorded) Mar 24 03:29:35.527: INFO: Container busybox-1 ready: true, restart count 0 Mar 24 03:29:35.527: INFO: Container busybox-2 ready: true, restart count 0 Mar 24 03:29:35.527: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:35.527: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:29:35.527: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:29:35.527: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:29:35.527: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:35.527: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:29:35.527: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:35.527: INFO: Container back-off ready: false, restart count 4 Mar 24 03:29:35.527: INFO: test-pod started at 2023-03-24 03:29:26 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:35.527: INFO: Container busybox-1 ready: true, restart count 0 Mar 24 03:29:35.527: INFO: Container busybox-2 ready: true, restart count 0 Mar 24 03:29:35.527: INFO: Container busybox-3 ready: true, restart count 0 Mar 24 03:29:35.527: INFO: liveness-8fd39a75-ca01-4e98-bd13-421a17c3db7d started at 2023-03-24 03:29:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:35.527: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:29:35.527: INFO: deleted-running-onfailure-511f2f8d-d630-41f8-b806-4780917804e4 started at 2023-03-24 03:29:32 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:35.527: INFO: Container deleted-running-onfailure-511f2f8d-d630-41f8-b806-4780917804e4 ready: true, restart count 0 W0324 03:29:35.528450 1191 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:29:36.513: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:36.513 (994ms) < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 03:29:36.513 (994ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 03:29:36.513 STEP: Destroying namespace "var-expansion-7382" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:29:36.513 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 03:29:36.515 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sVariable\sExpansion\sshould\sallow\ssubstituting\svalues\sin\sa\scontainer\'s\sargs\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-9167/pods/var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984/log?container=dapi-container&previous=false": stream error: stream ID 935; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:33:46.29from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 03:33:42.257 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:33:42.257 STEP: Building a namespace api object, basename var-expansion - test/e2e/framework/framework.go:250 @ 03/24/23 03:33:42.257 Mar 24 03:33:42.259: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 03:33:42.259 (3ms) > Enter [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:42.259 < Exit [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:42.26 (0s) > Enter [It] should allow substituting values in a container's args [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:95 @ 03/24/23 03:33:42.26 STEP: Creating a pod to test substitution in container's args - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:33:42.26 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:33:46.282 Mar 24 03:33:46.283: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984 container dapi-container: <nil> Mar 24 03:33:46.285: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-9167/pods/var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984/log?container=dapi-container&previous=false": stream error: stream ID 935; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:33:46.285 Mar 24 03:33:46.289: INFO: Unexpected error: <*fmt.wrapError | 0xc0011c5be0>: failed to get logs from var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-9167/pods/var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984/log?container=dapi-container&previous=false": stream error: stream ID 935; INTERNAL_ERROR; received from peer { msg: "failed to get logs from var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/var-expansion-9167/pods/var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984/log?container=dapi-container&previous=false\": stream error: stream ID 935; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0011ce6f0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-9167/pods/var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 935, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-9167/pods/var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984/log?container=dapi-container&previous=false": stream error: stream ID 935; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:33:46.29 < Exit [It] should allow substituting values in a container's args [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:95 @ 03/24/23 03:33:46.29 (4.03s) > Enter [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:46.29 Mar 24 03:33:46.290: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:46.291 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:46.291 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:46.291 (0s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 03:33:46.291 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:46.291 STEP: Collecting events from namespace "var-expansion-9167". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:33:46.291 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:33:46.293 Mar 24 03:33:46.293: INFO: At 2023-03-24 03:33:42 +0000 UTC - event for var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:33:46.293: INFO: At 2023-03-24 03:33:42 +0000 UTC - event for var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:33:46.293: INFO: At 2023-03-24 03:33:42 +0000 UTC - event for var-expansion-16cae6d6-818c-4a0d-a509-4ebc3dc96984: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:33:46.293: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:33:46.293: INFO: Mar 24 03:33:46.295: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:46.296: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:33:46.296: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:46.297: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:46.300: INFO: pod-handle-http-request started at 2023-03-24 03:33:35 +0000 UTC (0+2 container statuses recorded) Mar 24 03:33:46.300: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:33:46.300: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:33:46.300: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:46.300: INFO: Container test ready: true, restart count 0 Mar 24 03:33:46.300: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:46.300: INFO: Container client-container ready: true, restart count 0 Mar 24 03:33:46.300: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:46.300: INFO: Container back-off ready: true, restart count 8 Mar 24 03:33:46.300: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:33:46.300: INFO: Container creates-volume-test ready: false, restart count 0 Mar 24 03:33:46.300: INFO: Container dels-volume-test ready: false, restart count 0 Mar 24 03:33:46.300: INFO: Container upds-volume-test ready: false, restart count 0 Mar 24 03:33:46.300: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:46.300: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:33:46.300: INFO: downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5 started at 2023-03-24 03:33:43 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:46.300: INFO: Container client-container ready: false, restart count 0 W0324 03:33:46.301956 1204 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:33:46.851: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:46.851 (559ms) < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 03:33:46.851 (559ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 03:33:46.851 STEP: Destroying namespace "var-expansion-9167" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:33:46.851 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 03:33:46.89 (40ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sVariable\sExpansion\sshould\sallow\ssubstituting\svalues\sin\sa\scontainer\'s\scommand\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-1146/pods/var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66/log?container=dapi-container&previous=false": stream error: stream ID 1041; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:32:37.901from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 03:32:33.868 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:32:33.868 STEP: Building a namespace api object, basename var-expansion - test/e2e/framework/framework.go:250 @ 03/24/23 03:32:33.868 Mar 24 03:32:33.871: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 03:32:33.871 (3ms) > Enter [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:32:33.871 < Exit [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:32:33.871 (0s) > Enter [It] should allow substituting values in a container's command [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:76 @ 03/24/23 03:32:33.871 STEP: Creating a pod to test substitution in container's command - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:32:33.871 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:32:37.894 Mar 24 03:32:37.895: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66 container dapi-container: <nil> Mar 24 03:32:37.897: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-1146/pods/var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66/log?container=dapi-container&previous=false": stream error: stream ID 1041; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:32:37.897 Mar 24 03:32:37.901: INFO: Unexpected error: <*fmt.wrapError | 0xc0010f8ec0>: failed to get logs from var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-1146/pods/var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66/log?container=dapi-container&previous=false": stream error: stream ID 1041; INTERNAL_ERROR; received from peer { msg: "failed to get logs from var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/var-expansion-1146/pods/var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66/log?container=dapi-container&previous=false\": stream error: stream ID 1041; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000ce6f60>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-1146/pods/var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1041, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-1146/pods/var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66/log?container=dapi-container&previous=false": stream error: stream ID 1041; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:32:37.901 < Exit [It] should allow substituting values in a container's command [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:76 @ 03/24/23 03:32:37.901 (4.03s) > Enter [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:37.901 Mar 24 03:32:37.901: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:32:37.902 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:37.902 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:32:37.903 (0s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 03:32:37.903 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:37.903 STEP: Collecting events from namespace "var-expansion-1146". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:32:37.903 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:32:37.904 Mar 24 03:32:37.904: INFO: At 2023-03-24 03:32:34 +0000 UTC - event for var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:32:37.904: INFO: At 2023-03-24 03:32:34 +0000 UTC - event for var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 03:32:37.904: INFO: At 2023-03-24 03:32:34 +0000 UTC - event for var-expansion-26639be6-c726-4b02-8a55-8e7397cdde66: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 03:32:37.904: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:32:37.904: INFO: Mar 24 03:32:37.906: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:37.907: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:32:37.907: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:37.908: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:32:37.912: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:37.912: INFO: Container back-off ready: false, restart count 5 Mar 24 03:32:37.912: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:37.912: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:32:37.912: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:32:37.912: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:32:37.912: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:37.912: INFO: Container back-off-cap ready: false, restart count 3 Mar 24 03:32:37.912: INFO: pod-handle-http-request started at 2023-03-24 03:32:15 +0000 UTC (0+2 container statuses recorded) Mar 24 03:32:37.912: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:32:37.912: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:32:37.912: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:37.912: INFO: Container client-container ready: true, restart count 0 Mar 24 03:32:37.912: INFO: privileged-pod started at 2023-03-24 03:32:04 +0000 UTC (0+2 container statuses recorded) Mar 24 03:32:37.912: INFO: Container not-privileged-container ready: true, restart count 0 Mar 24 03:32:37.912: INFO: Container privileged-container ready: true, restart count 0 Mar 24 03:32:37.912: INFO: ephemeral-containers-target-pod started at 2023-03-24 03:32:06 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:37.912: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 03:32:37.912: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:32:37.912: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:32:37.912: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:32:37.912: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:32:37.912: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:32:37.912: INFO: Container agnhost-container ready: true, restart count 0 W0324 03:32:37.913092 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:32:37.986: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:32:37.986 (84ms) < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 03:32:37.986 (84ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 03:32:37.986 STEP: Destroying namespace "var-expansion-1146" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:32:37.986 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 03:32:37.989 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sbinary\sdata\sshould\sbe\sreflected\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 240.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc0010ccae0>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7643/pods/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/log?container=agnhost-container&previous=false": stream error: stream ID 603; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-7643/pods/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 603, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:230 @ 03/24/23 03:31:28.007from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:27:25.985 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:27:25.985 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:27:25.986 Mar 24 03:27:25.989: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:27:25.989 (3ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:27:25.989 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:27:25.989 (0s) > Enter [It] binary data should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:175 @ 03/24/23 03:27:25.989 Mar 24 03:27:25.990: INFO: Couldn't get node TTL annotation (using default value of 0): No TTL annotation found on the node STEP: Creating configMap with name configmap-test-upd-83485c5d-0d9a-4b53-9803-c7353743a608 - test/e2e/common/storage/configmap_volume.go:197 @ 03/24/23 03:27:25.99 STEP: Creating the pod - test/e2e/common/storage/configmap_volume.go:218 @ 03/24/23 03:27:25.992 STEP: Waiting for pod with text data - test/e2e/common/storage/configmap_volume.go:229 @ 03/24/23 03:27:28.006 [FAILED] Timed out after 240.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc0010ccae0>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7643/pods/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/log?container=agnhost-container&previous=false": stream error: stream ID 603; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-7643/pods/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 603, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:230 @ 03/24/23 03:31:28.007 < Exit [It] binary data should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:175 @ 03/24/23 03:31:28.007 (4m2.018s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:31:28.007 Mar 24 03:31:28.007: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:31:28.009 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:31:28.009 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:31:28.009 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:31:28.009 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:31:28.009 STEP: Collecting events from namespace "configmap-7643". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:31:28.009 STEP: Found 6 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:31:28.01 Mar 24 03:31:28.010: INFO: At 2023-03-24 03:27:26 +0000 UTC - event for pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:31:28.010: INFO: At 2023-03-24 03:27:26 +0000 UTC - event for pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:31:28.010: INFO: At 2023-03-24 03:27:26 +0000 UTC - event for pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:31:28.010: INFO: At 2023-03-24 03:27:26 +0000 UTC - event for pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 03:31:28.010: INFO: At 2023-03-24 03:27:26 +0000 UTC - event for pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container configmap-volume-binary-test Mar 24 03:31:28.010: INFO: At 2023-03-24 03:27:27 +0000 UTC - event for pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container configmap-volume-binary-test Mar 24 03:31:28.012: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:31:28.012: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:27:25 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:27:25 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:27:25 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:27:25 +0000 UTC }] Mar 24 03:31:28.012: INFO: Mar 24 03:31:28.013: INFO: Unable to fetch configmap-7643/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7643/pods/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 611; INTERNAL_ERROR; received from peer Mar 24 03:31:28.015: INFO: Unable to fetch configmap-7643/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/configmap-volume-binary-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7643/pods/pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154/log?container=configmap-volume-binary-test&previous=false&tailLines=42": stream error: stream ID 613; INTERNAL_ERROR; received from peer Mar 24 03:31:28.016: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:28.017: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:31:28.017: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:28.018: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:31:28.022: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:28.022: INFO: Container client-container ready: true, restart count 0 Mar 24 03:31:28.022: INFO: liveness-8fd39a75-ca01-4e98-bd13-421a17c3db7d started at 2023-03-24 03:29:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:28.022: INFO: Container agnhost-container ready: false, restart count 4 Mar 24 03:31:28.022: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:28.022: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:31:28.022: INFO: busybox-704809da-ddcf-4ec0-a3a4-57faed662267 started at 2023-03-24 03:30:43 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:28.022: INFO: Container busybox ready: true, restart count 0 Mar 24 03:31:28.022: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:31:28.022: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:31:28.022: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:31:28.022: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:31:28.022: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:31:28.022: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:31:28.022: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:31:28.022: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:31:28.022: INFO: Container back-off ready: false, restart count 5 Mar 24 03:31:28.022: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:31:28.022: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:31:28.022: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:31:28.022: INFO: Container upds-volume-test ready: true, restart count 0 W0324 03:31:28.022959 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:31:28.086: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:31:28.086 (77ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:31:28.086 (77ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:31:28.086 STEP: Destroying namespace "configmap-7643" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:31:28.086 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:31:28.088 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\soptional\supdates\sshould\sbe\sreflected\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 240.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc00167faa0>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7853/pods/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/log?container=createcm-volume-test&previous=false": stream error: stream ID 1245; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-7853/pods/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/log?container=createcm-volume-test&previous=false", Err: <http2.StreamError>{ StreamID: 1245, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:383 @ 03/24/23 03:33:10.172from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:29:08.142 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:29:08.142 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:29:08.142 Mar 24 03:29:08.145: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:29:08.145 (3ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:08.145 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:08.145 (0s) > Enter [It] optional updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:240 @ 03/24/23 03:29:08.145 Mar 24 03:29:08.146: INFO: Couldn't get node TTL annotation (using default value of 0): No TTL annotation found on the node STEP: Creating configMap with name cm-test-opt-del-2bf450f0-7dea-4c53-bef3-e8d5f166fcb1 - test/e2e/common/storage/configmap_volume.go:285 @ 03/24/23 03:29:08.146 STEP: Creating configMap with name cm-test-opt-upd-7fd418dc-96e8-40a5-8d9e-10814dd566f0 - test/e2e/common/storage/configmap_volume.go:291 @ 03/24/23 03:29:08.148 STEP: Creating the pod - test/e2e/common/storage/configmap_volume.go:377 @ 03/24/23 03:29:08.149 [FAILED] Timed out after 240.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc00167faa0>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7853/pods/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/log?container=createcm-volume-test&previous=false": stream error: stream ID 1245; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-7853/pods/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/log?container=createcm-volume-test&previous=false", Err: <http2.StreamError>{ StreamID: 1245, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:383 @ 03/24/23 03:33:10.172 < Exit [It] optional updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:240 @ 03/24/23 03:33:10.172 (4m2.027s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:10.172 Mar 24 03:33:10.172: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:10.177 (5ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:10.177 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:10.177 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:33:10.177 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:10.177 STEP: Collecting events from namespace "configmap-7853". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:33:10.177 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:33:10.183 Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:08 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:08 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container delcm-volume-test Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:08 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container delcm-volume-test Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:08 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:09 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container updcm-volume-test Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:09 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container updcm-volume-test Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:09 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:09 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container createcm-volume-test Mar 24 03:33:10.183: INFO: At 2023-03-24 03:29:09 +0000 UTC - event for pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container createcm-volume-test Mar 24 03:33:10.186: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:33:10.186: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:29:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:10 +0000 UTC PodFailed } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:10 +0000 UTC PodFailed } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:29:08 +0000 UTC }] Mar 24 03:33:10.186: INFO: Mar 24 03:33:10.187: INFO: Unable to fetch configmap-7853/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/delcm-volume-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7853/pods/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/log?container=delcm-volume-test&previous=false&tailLines=42": stream error: stream ID 1253; INTERNAL_ERROR; received from peer Mar 24 03:33:10.189: INFO: Unable to fetch configmap-7853/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/updcm-volume-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7853/pods/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/log?container=updcm-volume-test&previous=false&tailLines=42": stream error: stream ID 1255; INTERNAL_ERROR; received from peer Mar 24 03:33:10.190: INFO: Unable to fetch configmap-7853/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/createcm-volume-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7853/pods/pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590/log?container=createcm-volume-test&previous=false&tailLines=42": stream error: stream ID 1257; INTERNAL_ERROR; received from peer Mar 24 03:33:10.192: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:10.193: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:33:10.193: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:10.194: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:10.197: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:33:10.197: INFO: Container createcm-volume-test ready: false, restart count 0 Mar 24 03:33:10.197: INFO: Container delcm-volume-test ready: false, restart count 0 Mar 24 03:33:10.197: INFO: Container updcm-volume-test ready: false, restart count 0 Mar 24 03:33:10.197: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:10.197: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:33:10.197: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:10.197: INFO: Container back-off ready: false, restart count 5 Mar 24 03:33:10.197: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:33:10.197: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:33:10.197: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:33:10.197: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:33:10.197: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:10.197: INFO: Container back-off-cap ready: false, restart count 3 Mar 24 03:33:10.197: INFO: netserver-0 started at 2023-03-24 03:32:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:10.197: INFO: Container webserver ready: false, restart count 0 Mar 24 03:33:10.197: INFO: annotationupdatee4a09442-db94-4f47-a798-35464acbfd7e started at 2023-03-24 03:31:16 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:10.197: INFO: Container client-container ready: true, restart count 0 Mar 24 03:33:10.197: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:10.197: INFO: Container test ready: true, restart count 0 W0324 03:33:10.198606 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:33:10.241: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:10.241 (63ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:33:10.241 (63ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:33:10.241 STEP: Destroying namespace "configmap-7853" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:33:10.241 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:33:10.243 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3738/pods/pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22/log?container=agnhost-container&previous=false": stream error: stream ID 745; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:28:31.568from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:28:27.535 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:28:27.535 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:28:27.535 Mar 24 03:28:27.538: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:28:27.538 (3ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:27.538 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:27.538 (0s) > Enter [It] should be consumable from pods in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:47 @ 03/24/23 03:28:27.538 STEP: Creating configMap with name configmap-test-volume-08008ded-e059-4ee9-adec-5e5254b75890 - test/e2e/common/storage/configmap_volume.go:599 @ 03/24/23 03:28:27.538 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:28:27.539 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:28:31.56 Mar 24 03:28:31.561: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22 container agnhost-container: <nil> Mar 24 03:28:31.563: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3738/pods/pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22/log?container=agnhost-container&previous=false": stream error: stream ID 745; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:28:31.563 Mar 24 03:28:31.568: INFO: Unexpected error: <*fmt.wrapError | 0xc001013560>: failed to get logs from pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3738/pods/pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22/log?container=agnhost-container&previous=false": stream error: stream ID 745; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-3738/pods/pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22/log?container=agnhost-container&previous=false\": stream error: stream ID 745; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000c9dd10>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-3738/pods/pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 745, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3738/pods/pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22/log?container=agnhost-container&previous=false": stream error: stream ID 745; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:28:31.568 < Exit [It] should be consumable from pods in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:47 @ 03/24/23 03:28:31.568 (4.031s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:31.568 Mar 24 03:28:31.568: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:31.57 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:31.57 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:31.57 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:28:31.57 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:31.57 STEP: Collecting events from namespace "configmap-3738". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:28:31.57 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:28:31.577 Mar 24 03:28:31.577: INFO: At 2023-03-24 03:28:28 +0000 UTC - event for pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:28:31.577: INFO: At 2023-03-24 03:28:28 +0000 UTC - event for pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:28:31.577: INFO: At 2023-03-24 03:28:28 +0000 UTC - event for pod-configmaps-5c301806-7c2e-4b05-8c54-1ab2b7f29c22: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:28:31.577: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:28:31.577: INFO: Mar 24 03:28:31.580: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:31.581: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:28:31.581: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:31.583: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:31.587: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:28:31.587: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:28:31.587: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:28:31.587: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:28:31.587: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:31.587: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:28:31.587: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:28:31.587: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:31.587: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:28:31.587: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:31.587: INFO: Container back-off ready: false, restart count 3 Mar 24 03:28:31.587: INFO: pod-handle-http-request started at 2023-03-24 03:26:23 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:31.587: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:28:31.587: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:28:31.587: INFO: pod-with-poststart-http-hook started at 2023-03-24 03:26:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:31.587: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 03:28:31.587: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:31.587: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:28:31.587: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:31.587: INFO: Container client-container ready: false, restart count 0 Mar 24 03:28:31.587: INFO: static-pod-e56ead47-f755-451a-88e9-5c88c5627a1b-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:28:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:31.587: INFO: Container test ready: true, restart count 0 W0324 03:28:31.589023 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:28:31.644: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:31.644 (73ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:28:31.644 (73ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:28:31.644 STEP: Destroying namespace "configmap-3738" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:28:31.644 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:28:31.646 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\sas\snon\-root\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-136/pods/pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa/log?container=agnhost-container&previous=false": stream error: stream ID 1361; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:48.011from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:34:43.951 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:34:43.951 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:34:43.951 Mar 24 03:34:43.960: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:34:43.96 (9ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:43.96 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:43.96 (0s) > Enter [It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:74 @ 03/24/23 03:34:43.96 STEP: Creating configMap with name configmap-test-volume-aa79c5e7-4569-476a-88f1-884c0e96673d - test/e2e/common/storage/configmap_volume.go:599 @ 03/24/23 03:34:43.96 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:34:43.965 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:34:48.001 Mar 24 03:34:48.003: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa container agnhost-container: <nil> Mar 24 03:34:48.006: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-136/pods/pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa/log?container=agnhost-container&previous=false": stream error: stream ID 1361; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:34:48.006 Mar 24 03:34:48.011: INFO: Unexpected error: <*fmt.wrapError | 0xc0014a5d00>: failed to get logs from pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-136/pods/pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa/log?container=agnhost-container&previous=false": stream error: stream ID 1361; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-136/pods/pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa/log?container=agnhost-container&previous=false\": stream error: stream ID 1361; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001172120>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-136/pods/pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1361, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-136/pods/pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa/log?container=agnhost-container&previous=false": stream error: stream ID 1361; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:48.011 < Exit [It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:74 @ 03/24/23 03:34:48.011 (4.05s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:48.011 Mar 24 03:34:48.011: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:48.012 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:48.012 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:48.012 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:34:48.012 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:48.012 STEP: Collecting events from namespace "configmap-136". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:34:48.012 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:34:48.015 Mar 24 03:34:48.015: INFO: At 2023-03-24 03:34:44 +0000 UTC - event for pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:34:48.015: INFO: At 2023-03-24 03:34:44 +0000 UTC - event for pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:34:48.015: INFO: At 2023-03-24 03:34:44 +0000 UTC - event for pod-configmaps-57a99690-aff1-42ea-bb3c-4255e10d45fa: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:34:48.016: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:34:48.016: INFO: Mar 24 03:34:48.017: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:48.019: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:34:48.020: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:48.020: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:48.025: INFO: graceful-pod-09fdf188-1017-48de-b829-336fd87bd5f5-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:34:45 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:48.025: INFO: Container m-test ready: true, restart count 0 Mar 24 03:34:48.025: INFO: pod-ready started at 2023-03-24 03:34:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:48.025: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 24 03:34:48.025: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:48.025: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:34:48.025: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:48.025: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:34:48.025: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:48.025: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:48.025: INFO: busybox-526b8029-de36-4e8b-8faa-23e962a43443 started at 2023-03-24 03:34:34 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:48.025: INFO: Container busybox ready: true, restart count 0 Mar 24 03:34:48.025: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:34:48.025: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:34:48.025: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:34:48.025: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:34:48.025: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:48.025: INFO: Container client-container ready: true, restart count 0 W0324 03:34:48.025981 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:34:48.261: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:48.261 (249ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:34:48.261 (249ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:34:48.261 STEP: Destroying namespace "configmap-136" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:34:48.261 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:34:48.269 (8ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\sdefaultMode\sset\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-8112/pods/pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1/log?container=agnhost-container&previous=false": stream error: stream ID 105; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:11.878from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:25:05.795 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:25:05.795 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:25:05.796 Mar 24 03:25:05.805: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:25:05.805 (10ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:05.805 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:25:05.805 (1ms) > Enter [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:57 @ 03/24/23 03:25:05.805 STEP: Creating configMap with name configmap-test-volume-7f74011c-a91d-4060-8536-d58467fdb83e - test/e2e/common/storage/configmap_volume.go:599 @ 03/24/23 03:25:05.805 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:25:05.811 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:25:11.852 Mar 24 03:25:11.853: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 container agnhost-container: <nil> Mar 24 03:25:11.869: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-8112/pods/pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1/log?container=agnhost-container&previous=false": stream error: stream ID 105; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:25:11.869 Mar 24 03:25:11.878: INFO: Unexpected error: <*fmt.wrapError | 0xc000d4b6e0>: failed to get logs from pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-8112/pods/pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1/log?container=agnhost-container&previous=false": stream error: stream ID 105; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-8112/pods/pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1/log?container=agnhost-container&previous=false\": stream error: stream ID 105; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0015d2b40>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-8112/pods/pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 105, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-8112/pods/pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1/log?container=agnhost-container&previous=false": stream error: stream ID 105; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:25:11.878 < Exit [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:57 @ 03/24/23 03:25:11.878 (6.073s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:11.878 Mar 24 03:25:11.878: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:25:11.882 (4ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:11.882 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:25:11.882 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:25:11.882 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:11.882 STEP: Collecting events from namespace "configmap-8112". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:25:11.882 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:25:11.89 Mar 24 03:25:11.890: INFO: At 2023-03-24 03:25:07 +0000 UTC - event for pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:25:11.890: INFO: At 2023-03-24 03:25:07 +0000 UTC - event for pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:25:11.890: INFO: At 2023-03-24 03:25:07 +0000 UTC - event for pod-configmaps-5637158b-e30d-4b10-95d6-64927fa999e1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:25:11.892: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:25:11.892: INFO: Mar 24 03:25:11.894: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:11.898: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:25:11.899: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:11.901: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:25:11.910: INFO: pod59544fef-132c-48a4-9c23-f2fab7a12d65 started at 2023-03-24 03:25:03 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container container5663a1ff-e6c4-4622-bf3e-1e564e4823dd ready: false, restart count 0 Mar 24 03:25:11.910: INFO: stats-busybox-1 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container busybox-container ready: false, restart count 0 Mar 24 03:25:11.910: INFO: pod-host-path-test started at 2023-03-24 03:25:08 +0000 UTC (0+2 container statuses recorded) Mar 24 03:25:11.910: INFO: Container test-container-1 ready: false, restart count 0 Mar 24 03:25:11.910: INFO: Container test-container-2 ready: false, restart count 0 Mar 24 03:25:11.910: INFO: test-grpc-7d41a842-e74a-436a-ac79-7d47827a4b56 started at 2023-03-24 03:24:36 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:25:11.910: INFO: log-pod-d96fc004-0636-46ba-8b56-a0669d739721 started at 2023-03-24 03:25:01 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container logger ready: false, restart count 0 Mar 24 03:25:11.910: INFO: log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 started at 2023-03-24 03:25:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container log-cri-check-09acbbdc-8152-4b84-9b85-9e3da964c6f3 ready: false, restart count 0 Mar 24 03:25:11.910: INFO: downwardapi-volume-4e82d24a-9a36-467c-88ba-aa7e42be5724 started at 2023-03-24 03:25:11 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container client-container ready: false, restart count 0 Mar 24 03:25:11.910: INFO: pod51e69781-66dd-4938-9447-45259953fe14 started at 2023-03-24 03:24:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container container33ed3425-ff63-4dac-887a-19a0f9af1c27 ready: false, restart count 0 Mar 24 03:25:11.910: INFO: test-webserver-eb60fdfc-2a13-40fc-b29c-ab3da77ae76e started at 2023-03-24 03:24:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container test-webserver ready: false, restart count 0 Mar 24 03:25:11.910: INFO: stats-busybox-0 started at 2023-03-24 03:25:08 +0000 UTC (0+1 container statuses recorded) Mar 24 03:25:11.910: INFO: Container busybox-container ready: false, restart count 0 W0324 03:25:11.912683 1191 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:25:12.077: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:25:12.077 (195ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:25:12.077 (195ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:25:12.077 STEP: Destroying namespace "configmap-8112" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:25:12.077 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:25:12.088 (12ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\smappings\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5396/pods/pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1/log?container=agnhost-container&previous=false": stream error: stream ID 1225; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:27.801from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:34:23.767 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:34:23.767 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:34:23.767 Mar 24 03:34:23.770: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:34:23.77 (3ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:23.77 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:34:23.77 (0s) > Enter [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:89 @ 03/24/23 03:34:23.77 STEP: Creating configMap with name configmap-test-volume-map-417da621-095f-4020-9f22-051afe30d3bd - test/e2e/common/storage/configmap_volume.go:640 @ 03/24/23 03:34:23.77 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:34:23.772 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:34:27.793 Mar 24 03:34:27.795: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1 container agnhost-container: <nil> Mar 24 03:34:27.796: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5396/pods/pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1/log?container=agnhost-container&previous=false": stream error: stream ID 1225; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:34:27.796 Mar 24 03:34:27.801: INFO: Unexpected error: <*fmt.wrapError | 0xc0012fbb40>: failed to get logs from pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5396/pods/pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1/log?container=agnhost-container&previous=false": stream error: stream ID 1225; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-5396/pods/pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1/log?container=agnhost-container&previous=false\": stream error: stream ID 1225; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001606060>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-5396/pods/pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1225, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5396/pods/pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1/log?container=agnhost-container&previous=false": stream error: stream ID 1225; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:34:27.801 < Exit [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:89 @ 03/24/23 03:34:27.801 (4.031s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:27.801 Mar 24 03:34:27.801: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:34:27.803 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:27.803 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:34:27.803 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:34:27.803 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:27.803 STEP: Collecting events from namespace "configmap-5396". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:34:27.803 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:34:27.804 Mar 24 03:34:27.804: INFO: At 2023-03-24 03:34:24 +0000 UTC - event for pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:34:27.804: INFO: At 2023-03-24 03:34:24 +0000 UTC - event for pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:34:27.804: INFO: At 2023-03-24 03:34:24 +0000 UTC - event for pod-configmaps-8e5f5d19-9d8c-42a5-868b-f7f4c61f15c1: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:34:27.805: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:34:27.805: INFO: Mar 24 03:34:27.806: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:27.807: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:34:27.808: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:27.809: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:34:27.811: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:27.811: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:27.811: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:27.811: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:34:27.811: INFO: pod-ready started at 2023-03-24 03:34:18 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:27.811: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 24 03:34:27.811: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:27.811: INFO: Container client-container ready: true, restart count 0 Mar 24 03:34:27.811: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:34:27.811: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:34:27.811: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:34:27.811: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:34:27.811: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:34:27.811: INFO: Container back-off-cap ready: false, restart count 4 W0324 03:34:27.812779 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:34:29.974: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:34:29.974 (2.172s) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:34:29.974 (2.172s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:34:29.974 STEP: Destroying namespace "configmap-5396" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:34:29.975 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:34:29.977 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\smappings\sand\sItem\smode\sset\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6899/pods/pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22/log?container=agnhost-container&previous=false": stream error: stream ID 637; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:28:08.679from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:28:04.644 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:28:04.644 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:28:04.644 Mar 24 03:28:04.647: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:28:04.647 (3ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:04.647 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:04.647 (0s) > Enter [It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:99 @ 03/24/23 03:28:04.647 STEP: Creating configMap with name configmap-test-volume-map-e1566d96-7d28-42e2-9965-1cba47a4dc21 - test/e2e/common/storage/configmap_volume.go:640 @ 03/24/23 03:28:04.647 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:28:04.648 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:28:08.671 Mar 24 03:28:08.672: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22 container agnhost-container: <nil> Mar 24 03:28:08.674: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6899/pods/pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22/log?container=agnhost-container&previous=false": stream error: stream ID 637; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:28:08.674 Mar 24 03:28:08.679: INFO: Unexpected error: <*fmt.wrapError | 0xc000b888c0>: failed to get logs from pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6899/pods/pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22/log?container=agnhost-container&previous=false": stream error: stream ID 637; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-6899/pods/pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22/log?container=agnhost-container&previous=false\": stream error: stream ID 637; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000b30030>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-6899/pods/pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 637, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6899/pods/pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22/log?container=agnhost-container&previous=false": stream error: stream ID 637; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:28:08.679 < Exit [It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:99 @ 03/24/23 03:28:08.679 (4.032s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:08.679 Mar 24 03:28:08.679: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:08.68 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:08.68 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:08.68 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:28:08.68 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:08.68 STEP: Collecting events from namespace "configmap-6899". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:28:08.68 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:28:08.682 Mar 24 03:28:08.682: INFO: At 2023-03-24 03:28:05 +0000 UTC - event for pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:28:08.682: INFO: At 2023-03-24 03:28:05 +0000 UTC - event for pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:28:08.682: INFO: At 2023-03-24 03:28:05 +0000 UTC - event for pod-configmaps-640ee18e-01d2-4986-8a77-5dae2f304c22: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:28:08.682: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:28:08.682: INFO: Mar 24 03:28:08.684: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:08.685: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:28:08.685: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:08.686: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:08.690: INFO: test-container-pod started at 2023-03-24 03:28:01 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container webserver ready: true, restart count 0 Mar 24 03:28:08.690: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:28:08.690: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:28:08.690: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:28:08.690: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:28:08.690: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:08.690: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:28:08.690: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:28:08.690: INFO: netserver-0 started at 2023-03-24 03:27:51 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container webserver ready: true, restart count 0 Mar 24 03:28:08.690: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container back-off ready: false, restart count 3 Mar 24 03:28:08.690: INFO: pod-handle-http-request started at 2023-03-24 03:26:23 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:08.690: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:28:08.690: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:28:08.690: INFO: pod-with-poststart-http-hook started at 2023-03-24 03:26:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 03:28:08.690: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:28:08.690: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container client-container ready: false, restart count 0 Mar 24 03:28:08.690: INFO: host-test-container-pod started at 2023-03-24 03:28:01 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:28:08.690: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:08.690: INFO: Container agnhost ready: true, restart count 0 W0324 03:28:08.691370 1201 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:28:08.749: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:08.749 (69ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:28:08.749 (69ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:28:08.749 STEP: Destroying namespace "configmap-6899" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:28:08.749 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:28:08.751 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\smappings\sas\snon\-root\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-9878/pods/pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d/log?container=agnhost-container&previous=false": stream error: stream ID 325; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:27:25.903from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:27:21.867 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:27:21.867 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:27:21.867 Mar 24 03:27:21.870: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:27:21.87 (3ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:27:21.87 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:27:21.87 (0s) > Enter [It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:109 @ 03/24/23 03:27:21.87 STEP: Creating configMap with name configmap-test-volume-map-560659ec-cc30-45cc-b1da-fdfd7bbfb7f0 - test/e2e/common/storage/configmap_volume.go:640 @ 03/24/23 03:27:21.87 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:27:21.872 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:27:25.896 Mar 24 03:27:25.897: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d container agnhost-container: <nil> Mar 24 03:27:25.898: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-9878/pods/pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d/log?container=agnhost-container&previous=false": stream error: stream ID 325; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:27:25.898 Mar 24 03:27:25.903: INFO: Unexpected error: <*fmt.wrapError | 0xc00152fd20>: failed to get logs from pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-9878/pods/pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d/log?container=agnhost-container&previous=false": stream error: stream ID 325; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-9878/pods/pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d/log?container=agnhost-container&previous=false\": stream error: stream ID 325; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001230690>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-9878/pods/pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 325, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-9878/pods/pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d/log?container=agnhost-container&previous=false": stream error: stream ID 325; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:27:25.903 < Exit [It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:109 @ 03/24/23 03:27:25.903 (4.033s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:27:25.903 Mar 24 03:27:25.903: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:27:25.904 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:27:25.904 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:27:25.904 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:27:25.904 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:27:25.904 STEP: Collecting events from namespace "configmap-9878". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:27:25.904 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:27:25.905 Mar 24 03:27:25.905: INFO: At 2023-03-24 03:27:22 +0000 UTC - event for pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:27:25.906: INFO: At 2023-03-24 03:27:22 +0000 UTC - event for pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:27:25.906: INFO: At 2023-03-24 03:27:22 +0000 UTC - event for pod-configmaps-2c98a340-7ff3-4c8e-a795-9f2c4c489b3d: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:27:25.906: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:27:25.906: INFO: Mar 24 03:27:25.908: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:25.909: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:27:25.909: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:25.910: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:27:25.914: INFO: busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 started at 2023-03-24 03:26:15 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:25.914: INFO: Container busybox-readonly-fs0f43b6a1-d1c1-47fe-b88a-094fa3532b78 ready: true, restart count 0 Mar 24 03:27:25.914: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:25.914: INFO: Container back-off ready: true, restart count 2 Mar 24 03:27:25.914: INFO: pod-handle-http-request started at 2023-03-24 03:26:23 +0000 UTC (0+2 container statuses recorded) Mar 24 03:27:25.914: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:27:25.914: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:27:25.914: INFO: pod-with-poststart-http-hook started at 2023-03-24 03:26:25 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:25.914: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 03:27:25.914: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:25.914: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:27:25.914: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:25.914: INFO: Container client-container ready: true, restart count 0 Mar 24 03:27:25.914: INFO: pod-with-poststart-https-hook started at 2023-03-24 03:25:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:25.914: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 Mar 24 03:27:25.914: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:27:25.914: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:27:25.914: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:27:25.914: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:27:25.914: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:27:25.914: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:27:25.914: INFO: pod-handle-http-request started at 2023-03-24 03:25:37 +0000 UTC (0+2 container statuses recorded) Mar 24 03:27:25.914: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:27:25.914: INFO: Container container-handle-https-request ready: true, restart count 0 W0324 03:27:25.914972 1222 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:27:25.982: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:27:25.982 (77ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:27:25.982 (77ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:27:25.982 STEP: Destroying namespace "configmap-9878" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:27:25.982 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:27:25.984 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sin\smultiple\svolumes\sin\sthe\ssame\spod\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd for configmap-volume-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3214/pods/pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd/log?container=configmap-volume-test&previous=false": stream error: stream ID 787; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:28:35.682from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:28:31.647 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:28:31.647 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:28:31.647 Mar 24 03:28:31.651: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:28:31.651 (5ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:31.651 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:28:31.651 (0s) > Enter [It] should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:423 @ 03/24/23 03:28:31.651 STEP: Creating configMap with name configmap-test-volume-70a443b2-8e54-4fdb-9e08-70c530e21cc1 - test/e2e/common/storage/configmap_volume.go:433 @ 03/24/23 03:28:31.651 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:28:31.654 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:28:35.674 Mar 24 03:28:35.676: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd container configmap-volume-test: <nil> Mar 24 03:28:35.677: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd" container "configmap-volume-test". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3214/pods/pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd/log?container=configmap-volume-test&previous=false": stream error: stream ID 787; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:28:35.677 Mar 24 03:28:35.682: INFO: Unexpected error: <*fmt.wrapError | 0xc000aea780>: failed to get logs from pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd for configmap-volume-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3214/pods/pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd/log?container=configmap-volume-test&previous=false": stream error: stream ID 787; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd for configmap-volume-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-3214/pods/pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd/log?container=configmap-volume-test&previous=false\": stream error: stream ID 787; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000e2e120>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-3214/pods/pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd/log?container=configmap-volume-test&previous=false", Err: <http2.StreamError>{ StreamID: 787, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd for configmap-volume-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3214/pods/pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd/log?container=configmap-volume-test&previous=false": stream error: stream ID 787; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:28:35.682 < Exit [It] should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:423 @ 03/24/23 03:28:35.682 (4.031s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:35.682 Mar 24 03:28:35.682: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:28:35.684 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:35.684 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:28:35.684 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:28:35.684 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:35.684 STEP: Collecting events from namespace "configmap-3214". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:28:35.684 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:28:35.685 Mar 24 03:28:35.685: INFO: At 2023-03-24 03:28:32 +0000 UTC - event for pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:28:35.685: INFO: At 2023-03-24 03:28:32 +0000 UTC - event for pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container configmap-volume-test Mar 24 03:28:35.685: INFO: At 2023-03-24 03:28:32 +0000 UTC - event for pod-configmaps-83fc825a-12fc-4c62-9eda-7b18cb701efd: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container configmap-volume-test Mar 24 03:28:35.686: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:28:35.686: INFO: Mar 24 03:28:35.687: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:35.688: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:28:35.688: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:35.689: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:28:35.692: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:28:35.692: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:28:35.692: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:28:35.692: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:28:35.692: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:28:35.692: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:28:35.692: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:28:35.692: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:35.692: INFO: Container back-off ready: false, restart count 3 Mar 24 03:28:35.692: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:35.692: INFO: Container test-webserver ready: true, restart count 0 Mar 24 03:28:35.692: INFO: labelsupdateea61e2bf-e08a-47ca-9b4a-7b8376d85617 started at 2023-03-24 03:25:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:35.692: INFO: Container client-container ready: false, restart count 0 Mar 24 03:28:35.692: INFO: static-pod-e56ead47-f755-451a-88e9-5c88c5627a1b-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:28:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:35.692: INFO: Container test ready: true, restart count 0 Mar 24 03:28:35.692: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:28:35.692: INFO: Container agnhost ready: true, restart count 0 W0324 03:28:35.693341 1192 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:28:35.738: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:28:35.738 (55ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:28:35.741 (57ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:28:35.741 STEP: Destroying namespace "configmap-3214" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:28:35.741 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:28:35.744 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\supdates\sshould\sbe\sreflected\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 240.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc001728300>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5172/pods/pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f/log?container=agnhost-container&previous=false": stream error: stream ID 949; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-5172/pods/pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 949, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:158 @ 03/24/23 03:33:34.937from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:29:30.896 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:29:30.896 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 03:29:30.896 Mar 24 03:29:30.900: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 03:29:30.9 (4ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:30.9 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:30.9 (0s) > Enter [It] updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:124 @ 03/24/23 03:29:30.9 Mar 24 03:29:30.901: INFO: Couldn't get node TTL annotation (using default value of 0): No TTL annotation found on the node STEP: Creating configMap with name configmap-test-upd-4a4c2ae4-01b4-4442-bd38-0e1843bb413a - test/e2e/common/storage/configmap_volume.go:142 @ 03/24/23 03:29:30.901 STEP: Creating the pod - test/e2e/common/storage/configmap_volume.go:151 @ 03/24/23 03:29:30.903 [FAILED] Timed out after 240.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc001728300>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5172/pods/pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f/log?container=agnhost-container&previous=false": stream error: stream ID 949; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-5172/pods/pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 949, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:158 @ 03/24/23 03:33:34.937 < Exit [It] updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:124 @ 03/24/23 03:33:34.937 (4m4.037s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:34.937 Mar 24 03:33:34.937: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:34.939 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:34.939 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:34.939 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:33:34.939 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:34.939 STEP: Collecting events from namespace "configmap-5172". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:33:34.939 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:33:34.941 Mar 24 03:33:34.941: INFO: At 2023-03-24 03:29:32 +0000 UTC - event for pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:33:34.941: INFO: At 2023-03-24 03:29:32 +0000 UTC - event for pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 03:33:34.941: INFO: At 2023-03-24 03:29:32 +0000 UTC - event for pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 03:33:34.942: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:33:34.942: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:29:30 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:33 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:33:33 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 03:29:30 +0000 UTC }] Mar 24 03:33:34.942: INFO: Mar 24 03:33:34.944: INFO: Unable to fetch configmap-5172/pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5172/pods/pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 957; INTERNAL_ERROR; received from peer Mar 24 03:33:34.945: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:34.946: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:33:34.947: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:34.948: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:34.951: INFO: pod-configmaps-afe9bcbe-d872-4adf-a966-ab0047a9482f started at 2023-03-24 03:29:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:34.951: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 03:33:34.951: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:34.951: INFO: Container back-off ready: false, restart count 7 Mar 24 03:33:34.951: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:33:34.951: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:33:34.951: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:33:34.951: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:33:34.951: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:34.951: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:33:34.951: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:34.951: INFO: Container test ready: true, restart count 0 Mar 24 03:33:34.951: INFO: static-pod-5748b13b-04ec-48e5-be4e-81f49e3c16c3-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at <nil> (0+0 container statuses recorded) Mar 24 03:33:34.951: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:34.951: INFO: Container client-container ready: true, restart count 0 Mar 24 03:33:34.951: INFO: test-webserver-1994fafa-ee2d-4154-b743-15a3b74d2469 started at 2023-03-24 03:33:13 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:34.951: INFO: Container test-webserver ready: true, restart count 0 W0324 03:33:34.951968 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:33:34.996: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:34.996 (57ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 03:33:34.996 (57ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:33:34.996 STEP: Destroying namespace "configmap-5172" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:33:34.996 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 03:33:34.998 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\scpu\slimit\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7764/pods/downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f/log?container=client-container&previous=false": stream error: stream ID 1629; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:35:32.79from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:35:28.757 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:35:28.757 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:35:28.757 Mar 24 03:35:28.759: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:35:28.759 (3ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:28.759 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:35:28.759 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:35:28.759 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:35:28.759 (0s) > Enter [It] should provide container's cpu limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:194 @ 03/24/23 03:35:28.759 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:35:28.759 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:35:32.779 Mar 24 03:35:32.781: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f container client-container: <nil> Mar 24 03:35:32.783: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7764/pods/downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f/log?container=client-container&previous=false": stream error: stream ID 1629; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:35:32.783 Mar 24 03:35:32.789: INFO: Unexpected error: <*fmt.wrapError | 0xc0014a5260>: failed to get logs from downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7764/pods/downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f/log?container=client-container&previous=false": stream error: stream ID 1629; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-7764/pods/downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f/log?container=client-container&previous=false\": stream error: stream ID 1629; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000f7f740>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7764/pods/downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 1629, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7764/pods/downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f/log?container=client-container&previous=false": stream error: stream ID 1629; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:35:32.79 < Exit [It] should provide container's cpu limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:194 @ 03/24/23 03:35:32.79 (4.03s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:32.79 Mar 24 03:35:32.790: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:35:32.793 (3ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:32.793 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:35:32.793 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 03:35:32.793 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:32.793 STEP: Collecting events from namespace "downward-api-7764". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:35:32.793 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:35:32.794 Mar 24 03:35:32.794: INFO: At 2023-03-24 03:35:29 +0000 UTC - event for downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:35:32.794: INFO: At 2023-03-24 03:35:29 +0000 UTC - event for downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 03:35:32.794: INFO: At 2023-03-24 03:35:29 +0000 UTC - event for downwardapi-volume-1ce43518-4149-4620-b9dd-2698d1f4476f: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 03:35:32.795: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:35:32.795: INFO: Mar 24 03:35:32.796: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:32.798: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 4189 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:35:21 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:35:21 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:35:32.798: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:32.799: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:35:32.804: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container client-container ready: true, restart count 0 Mar 24 03:35:32.804: INFO: pod866ab006-2454-4868-a0b5-35752dbf6d60 started at 2023-03-24 03:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container container7f62bcd7-bdd9-4ba8-8a8b-c6975b74cc19 ready: false, restart count 0 Mar 24 03:35:32.804: INFO: pod-projected-secrets-19c8bc02-a277-460c-a04d-3c9625181ff4 started at 2023-03-24 03:34:15 +0000 UTC (0+3 container statuses recorded) Mar 24 03:35:32.804: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 03:35:32.804: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 03:35:32.804: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 03:35:32.804: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container back-off-cap ready: false, restart count 5 Mar 24 03:35:32.804: INFO: pod-exec-websocket-3dd9f1e0-7e4a-4e6a-aaad-3031d37ad42d started at 2023-03-24 03:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container main ready: true, restart count 0 Mar 24 03:35:32.804: INFO: downward-api-fdb9cf1f-4123-4847-ba46-293c83363eb1 started at 2023-03-24 03:35:30 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container dapi-container ready: false, restart count 0 Mar 24 03:35:32.804: INFO: termination-message-container2a119df5-2d9a-4870-93ea-272742f2d233 started at 2023-03-24 03:35:31 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container termination-message-container ready: false, restart count 0 Mar 24 03:35:32.804: INFO: podd3968ee7-1343-4513-8ee6-7b69bb6140e1 started at 2023-03-24 03:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container containerc5517caa-a6e0-4230-82a2-35962c8a7cc1 ready: false, restart count 0 Mar 24 03:35:32.804: INFO: liveness-657b1e59-4e76-4f34-ad44-2440f979c25b started at 2023-03-24 03:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 03:35:32.804: INFO: Container agnhost-container ready: true, restart count 0 W0324 03:35:32.804965 1190 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:35:35.117: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:35:35.117 (2.324s) < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 03:35:35.117 (2.324s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 03:35:35.117 STEP: Destroying namespace "downward-api-7764" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:35:35.117 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 03:35:35.119 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\scpu\srequest\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3508/pods/downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5/log?container=client-container&previous=false": stream error: stream ID 1067; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:33:47.771from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:33:43.713 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:33:43.713 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:33:43.713 Mar 24 03:33:43.716: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:33:43.716 (3ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:43.716 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:33:43.716 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:33:43.716 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:33:43.716 (0s) > Enter [It] should provide container's cpu request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:222 @ 03/24/23 03:33:43.716 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:33:43.716 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:33:47.742 Mar 24 03:33:47.743: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5 container client-container: <nil> Mar 24 03:33:47.758: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3508/pods/downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5/log?container=client-container&previous=false": stream error: stream ID 1067; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:33:47.758 Mar 24 03:33:47.771: INFO: Unexpected error: <*fmt.wrapError | 0xc000412640>: failed to get logs from downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3508/pods/downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5/log?container=client-container&previous=false": stream error: stream ID 1067; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5 for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-3508/pods/downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5/log?container=client-container&previous=false\": stream error: stream ID 1067; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00113ec00>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3508/pods/downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 1067, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3508/pods/downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5/log?container=client-container&previous=false": stream error: stream ID 1067; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:33:47.771 < Exit [It] should provide container's cpu request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:222 @ 03/24/23 03:33:47.771 (4.055s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:47.771 Mar 24 03:33:47.771: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:33:47.773 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:47.773 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:33:47.773 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 03:33:47.773 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:47.773 STEP: Collecting events from namespace "downward-api-3508". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:33:47.773 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:33:47.774 Mar 24 03:33:47.774: INFO: At 2023-03-24 03:33:44 +0000 UTC - event for downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:33:47.774: INFO: At 2023-03-24 03:33:44 +0000 UTC - event for downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 03:33:47.774: INFO: At 2023-03-24 03:33:44 +0000 UTC - event for downwardapi-volume-2e3deb30-72e3-44b2-a899-39262e9a86f5: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 03:33:47.775: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:33:47.775: INFO: Mar 24 03:33:47.777: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:47.779: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 2346 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:30:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:30:12 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:33:47.779: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:47.781: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:33:47.786: INFO: pod-handle-http-request started at 2023-03-24 03:33:35 +0000 UTC (0+2 container statuses recorded) Mar 24 03:33:47.786: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 03:33:47.786: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 03:33:47.786: INFO: static-pod-aefa5f94-b9fd-4fac-9535-ad23960e7990-tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 started at 2023-03-24 03:33:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:47.786: INFO: Container test ready: true, restart count 0 Mar 24 03:33:47.786: INFO: labelsupdatedcfc413b-3739-4742-b71b-a22a53595b85 started at 2023-03-24 03:33:22 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:47.786: INFO: Container client-container ready: true, restart count 0 Mar 24 03:33:47.786: INFO: initcontainer-test-pod-failure started at 2023-03-24 03:33:46 +0000 UTC (1+1 container statuses recorded) Mar 24 03:33:47.786: INFO: Init container init-1 ready: false, restart count 0 Mar 24 03:33:47.786: INFO: Container regular-1 ready: false, restart count 0 Mar 24 03:33:47.786: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:47.786: INFO: Container back-off ready: false, restart count 8 Mar 24 03:33:47.786: INFO: pod-secrets-d1868f54-051a-4e26-bb4b-fd9af0953f19 started at 2023-03-24 03:29:40 +0000 UTC (0+3 container statuses recorded) Mar 24 03:33:47.786: INFO: Container creates-volume-test ready: false, restart count 0 Mar 24 03:33:47.786: INFO: Container dels-volume-test ready: false, restart count 0 Mar 24 03:33:47.786: INFO: Container upds-volume-test ready: false, restart count 0 Mar 24 03:33:47.786: INFO: back-off-cap started at 2023-03-24 03:31:35 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:47.786: INFO: Container back-off-cap ready: false, restart count 4 Mar 24 03:33:47.786: INFO: pod-90f12b4a-8332-4c42-b05d-13e61e4a1bbb started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:47.786: INFO: Container test-container ready: false, restart count 0 Mar 24 03:33:47.786: INFO: annotationupdate2bf3c7fd-8006-41e1-8b65-369a2e08a1cd started at 2023-03-24 03:33:46 +0000 UTC (0+1 container statuses recorded) Mar 24 03:33:47.786: INFO: Container client-container ready: false, restart count 0 W0324 03:33:47.787095 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:33:49.942: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:33:49.942 (2.169s) < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 03:33:49.942 (2.169s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 03:33:49.942 STEP: Destroying namespace "downward-api-3508" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:33:49.942 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 03:33:49.945 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\smemory\slimit\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-561/pods/downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05/log?container=client-container&previous=false": stream error: stream ID 601; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:13.576from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:29:09.543 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:29:09.543 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:29:09.543 Mar 24 03:29:09.546: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:29:09.546 (3ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:09.546 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:29:09.546 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:29:09.546 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:29:09.546 (0s) > Enter [It] should provide container's memory limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:208 @ 03/24/23 03:29:09.546 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:29:09.546 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:29:13.568 Mar 24 03:29:13.569: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05 container client-container: <nil> Mar 24 03:29:13.571: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-561/pods/downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05/log?container=client-container&previous=false": stream error: stream ID 601; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:29:13.571 Mar 24 03:29:13.576: INFO: Unexpected error: <*fmt.wrapError | 0xc000679520>: failed to get logs from downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-561/pods/downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05/log?container=client-container&previous=false": stream error: stream ID 601; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05 for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-561/pods/downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05/log?container=client-container&previous=false\": stream error: stream ID 601; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0016cd320>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-561/pods/downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 601, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-561/pods/downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05/log?container=client-container&previous=false": stream error: stream ID 601; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:29:13.576 < Exit [It] should provide container's memory limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:208 @ 03/24/23 03:29:13.576 (4.03s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:13.576 Mar 24 03:29:13.576: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:29:13.577 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:13.577 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:29:13.577 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 03:29:13.577 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:13.577 STEP: Collecting events from namespace "downward-api-561". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:29:13.577 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:29:13.578 Mar 24 03:29:13.578: INFO: At 2023-03-24 03:29:10 +0000 UTC - event for downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:29:13.578: INFO: At 2023-03-24 03:29:10 +0000 UTC - event for downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 03:29:13.578: INFO: At 2023-03-24 03:29:10 +0000 UTC - event for downwardapi-volume-a40eefdc-2696-4ab4-b14f-ae8a1ea13f05: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 03:29:13.579: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:29:13.579: INFO: Mar 24 03:29:13.580: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:13.582: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 bcf49fae-d96a-48b5-a59e-33d114b7eef6 536 0 2023-03-24 03:24:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 03:24:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 03:25:05 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:34 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 03:25:05 +0000 UTC,LastTransitionTime:2023-03-24 03:24:35 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.79,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fbb206c50b13f904445a84750a89b01e,SystemUUID:fbb206c5-0b13-f904-445a-84750a89b01e,BootID:cf9e6852-7424-4c69-a913-59f08271e460,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 03:29:13.582: INFO: Logging kubelet events for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:13.583: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:29:13.586: INFO: test-grpc-437ccd3d-8661-4a98-b569-9794742482f7 started at 2023-03-24 03:25:29 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:13.586: INFO: Container agnhost ready: true, restart count 0 Mar 24 03:29:13.586: INFO: netserver-0 started at 2023-03-24 03:28:45 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:13.586: INFO: Container webserver ready: false, restart count 0 Mar 24 03:29:13.586: INFO: pod-projected-configmaps-45b7d360-10a2-45fe-b3ad-9a0857f9a832 started at 2023-03-24 03:25:18 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:13.586: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:29:13.586: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:29:13.586: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:29:13.586: INFO: pod-configmaps-1507432e-9873-47c3-8f0b-26ffaea59154 started at 2023-03-24 03:27:25 +0000 UTC (0+2 container statuses recorded) Mar 24 03:29:13.586: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 03:29:13.586: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 03:29:13.586: INFO: test-container-pod started at 2023-03-24 03:29:05 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:13.587: INFO: Container webserver ready: false, restart count 0 Mar 24 03:29:13.587: INFO: pod-configmaps-631e4a5e-6985-4fb9-a433-3f8dc2a8d590 started at 2023-03-24 03:29:08 +0000 UTC (0+3 container statuses recorded) Mar 24 03:29:13.587: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 03:29:13.587: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 03:29:13.587: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 03:29:13.587: INFO: pod-back-off-image started at 2023-03-24 03:26:59 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:13.587: INFO: Container back-off ready: false, restart count 4 Mar 24 03:29:13.587: INFO: container-must-be-restarted started at 2023-03-24 03:28:39 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:13.587: INFO: Container regular-1 ready: false, restart count 2 Mar 24 03:29:13.587: INFO: test-webserver-1d1b9203-6aae-4be3-af9d-fe61e6d3def0 started at 2023-03-24 03:26:27 +0000 UTC (0+1 container statuses recorded) Mar 24 03:29:13.587: INFO: Container test-webserver ready: true, restart count 0 W0324 03:29:13.587957 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 03:29:13.646: INFO: Latency metrics for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:29:13.646 (68ms) < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 03:29:13.646 (68ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 03:29:13.646 STEP: Destroying namespace "downward-api-561" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 03:29:13.646 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 03:29:13.648 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\smemory\srequest\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-278/pods/downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba/log?container=client-container&previous=false": stream error: stream ID 19; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:24:44.663
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:24:36.421 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 03:24:36.421 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 03:24:36.421 Mar 24 03:24:36.501: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 03:24:36.501 (80ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:36.501 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 03:24:36.501 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:24:36.501 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 03:24:36.501 (0s) > Enter [It] should provide container's memory request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:236 @ 03/24/23 03:24:36.501 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 03:24:36.501 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 03:24:44.646 Mar 24 03:24:44.648: INFO: Trying to get logs from node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 pod downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba container client-container: <nil> Mar 24 03:24:44.653: INFO: Failed to get logs from node "tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42" pod "downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-278/pods/downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba/log?container=client-container&previous=false": stream error: stream ID 19; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 03:24:44.654 Mar 24 03:24:44.663: INFO: Unexpected error: <*fmt.wrapError | 0xc0003be340>: failed to get logs from downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-278/pods/downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba/log?container=client-container&previous=false": stream error: stream ID 19; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-278/pods/downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba/log?container=client-container&previous=false\": stream error: stream ID 19; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001196210>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-278/pods/downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 19, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-278/pods/downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba/log?container=client-container&previous=false": stream error: stream ID 19; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 03:24:44.663 < Exit [It] should provide container's memory request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:236 @ 03/24/23 03:24:44.663 (8.162s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:24:44.663 Mar 24 03:24:44.663: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 03:24:44.665 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:24:44.665 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 03:24:44.665 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 03:24:44.665 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 03:24:44.665 STEP: Collecting events from namespace "downward-api-278". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 03:24:44.665 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 03:24:44.666 Mar 24 03:24:44.666: INFO: At 2023-03-24 03:24:40 +0000 UTC - event for downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 03:24:44.666: INFO: At 2023-03-24 03:24:40 +0000 UTC - event for downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 03:24:44.666: INFO: At 2023-03-24 03:24:40 +0000 UTC - event for downwardapi-volume-c5212ce3-ebb7-4cf9-891d-8f1ddada29ba: {kubelet tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 03:24:44.667: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 03:24:44.667: INFO: Mar 24 03:24:44.668: INFO: Logging node info for node tmp-node-e2e-5f5de2b5-cos-stable-101-17162-127-42 Mar 24 03:24:44.670: INFO: Node Info: &Node{ObjectMeta:{tmp-n