go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sConfigMap\sshould\sbe\sconsumable\svia\senvironment\svariable\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-573/pods/pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710/log?container=env-test&previous=false": stream error: stream ID 377; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:45.991from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:41.926 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:27:41.926 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:27:41.926 Mar 24 02:27:41.930: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:41.93 (4ms) > Enter [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:41.93 < Exit [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:41.93 (0s) > Enter [It] should be consumable via environment variable [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:45 @ 03/24/23 02:27:41.93 STEP: Creating configMap configmap-573/configmap-test-97a249fd-5d1d-4c14-b049-83be5c76e8dc - test/e2e/common/node/configmap.go:48 @ 03/24/23 02:27:41.93 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:27:41.934 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:27:45.981 Mar 24 02:27:45.983: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710 container env-test: <nil> Mar 24 02:27:45.985: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710" container "env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-573/pods/pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710/log?container=env-test&previous=false": stream error: stream ID 377; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:27:45.985 Mar 24 02:27:45.991: INFO: Unexpected error: <*fmt.wrapError | 0xc000a6f100>: failed to get logs from pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-573/pods/pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710/log?container=env-test&previous=false": stream error: stream ID 377; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710 for env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-573/pods/pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710/log?container=env-test&previous=false\": stream error: stream ID 377; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00105d950>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-573/pods/pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 377, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-573/pods/pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710/log?container=env-test&previous=false": stream error: stream ID 377; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:45.991 < Exit [It] should be consumable via environment variable [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:45 @ 03/24/23 02:27:45.991 (4.061s) > Enter [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:45.991 Mar 24 02:27:45.991: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:45.992 (2ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:45.992 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:45.992 (0s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:27:45.992 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:45.992 STEP: Collecting events from namespace "configmap-573". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:27:45.992 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:27:45.994 Mar 24 02:27:45.994: INFO: At 2023-03-24 02:27:43 +0000 UTC - event for pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:27:45.994: INFO: At 2023-03-24 02:27:43 +0000 UTC - event for pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container env-test Mar 24 02:27:45.994: INFO: At 2023-03-24 02:27:43 +0000 UTC - event for pod-configmaps-9574454f-6d3d-4185-95aa-8b16b78fe710: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container env-test Mar 24 02:27:45.995: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:27:45.995: INFO: Mar 24 02:27:45.996: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:45.997: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:27:45.998: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:45.999: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:46.005: INFO: var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8 started at 2023-03-24 02:27:40 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container dapi-container ready: false, restart count 0 Mar 24 02:27:46.005: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:27:46.005: INFO: test-webserver-37d56ffe-a0ed-4d9b-ad1c-8044529376fb started at 2023-03-24 02:27:21 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container test-webserver ready: false, restart count 0 Mar 24 02:27:46.005: INFO: pod-update-activedeadlineseconds-1db3ec8b-e3b7-4c59-b9a8-cf92e47ca485 started at 2023-03-24 02:27:35 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container pause ready: false, restart count 0 Mar 24 02:27:46.005: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:27:46.005: INFO: test-container-pod started at 2023-03-24 02:27:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container webserver ready: true, restart count 0 Mar 24 02:27:46.005: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:27:46.005: INFO: netserver-0 started at 2023-03-24 02:27:17 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container webserver ready: true, restart count 0 Mar 24 02:27:46.005: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container client-container ready: true, restart count 0 Mar 24 02:27:46.005: INFO: host-test-container-pod started at 2023-03-24 02:27:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:27:46.005: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.005: INFO: Container back-off ready: true, restart count 3 W0324 02:27:46.006542 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:27:48.119: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:48.119 (2.127s) < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:27:48.119 (2.127s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:27:48.119 STEP: Destroying namespace "configmap-573" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:27:48.119 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:27:48.129 (9ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sConfigMap\sshould\sbe\sconsumable\svia\sthe\senvironment\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7721/pods/pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60/log?container=env-test&previous=false": stream error: stream ID 709; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:33:57.363from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:33:55.299 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:33:55.299 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:33:55.299 Mar 24 02:33:55.303: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:33:55.303 (4ms) > Enter [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:33:55.303 < Exit [BeforeEach] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:33:55.303 (0s) > Enter [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:93 @ 03/24/23 02:33:55.303 STEP: Creating configMap configmap-7721/configmap-test-67289dcc-2c7a-4eb4-a8d9-cf1076b6a131 - test/e2e/common/node/configmap.go:96 @ 03/24/23 02:33:55.304 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:33:55.306 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:33:57.355 Mar 24 02:33:57.356: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60 container env-test: <nil> Mar 24 02:33:57.358: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60" container "env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7721/pods/pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60/log?container=env-test&previous=false": stream error: stream ID 709; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:33:57.358 Mar 24 02:33:57.363: INFO: Unexpected error: <*fmt.wrapError | 0xc000b400c0>: failed to get logs from pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7721/pods/pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60/log?container=env-test&previous=false": stream error: stream ID 709; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60 for env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-7721/pods/pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60/log?container=env-test&previous=false\": stream error: stream ID 709; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001020c90>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-7721/pods/pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 709, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-7721/pods/pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60/log?container=env-test&previous=false": stream error: stream ID 709; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:33:57.363 < Exit [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/configmap.go:93 @ 03/24/23 02:33:57.363 (2.059s) > Enter [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:33:57.363 Mar 24 02:33:57.363: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:33:57.365 (2ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:33:57.365 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:33:57.365 (0s) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:33:57.365 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:33:57.365 STEP: Collecting events from namespace "configmap-7721". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:33:57.365 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:33:57.366 Mar 24 02:33:57.366: INFO: At 2023-03-24 02:33:55 +0000 UTC - event for pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:33:57.366: INFO: At 2023-03-24 02:33:55 +0000 UTC - event for pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container env-test Mar 24 02:33:57.366: INFO: At 2023-03-24 02:33:55 +0000 UTC - event for pod-configmaps-4e6c53d4-8f4b-4238-8d0c-5ebee5aaef60: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container env-test Mar 24 02:33:57.367: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:33:57.367: INFO: Mar 24 02:33:57.368: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:33:57.370: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:33:57.370: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:33:57.371: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:33:57.374: INFO: pod-handle-http-request started at 2023-03-24 02:32:00 +0000 UTC (0+2 container statuses recorded) Mar 24 02:33:57.374: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:33:57.374: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:33:57.374: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df started at 2023-03-24 02:33:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:33:57.374: INFO: Container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df ready: true, restart count 0 Mar 24 02:33:57.374: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:33:57.374: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:33:57.374: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:33:57.374: INFO: Container client-container ready: true, restart count 0 Mar 24 02:33:57.374: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:33:57.374: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:33:57.374: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:33:57.374: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:33:57.374: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:33:57.374: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:33:57.374: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:33:57.374: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:33:57.374: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:33:57.374: INFO: pod-with-poststart-https-hook started at 2023-03-24 02:32:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:33:57.374: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 W0324 02:33:57.375941 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:33:57.445: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:33:57.445 (81ms) < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:33:57.445 (81ms) > Enter [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:33:57.445 STEP: Destroying namespace "configmap-7721" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:33:57.445 < Exit [DeferCleanup (Each)] [sig-node] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:33:57.448 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc00159b080>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 02:38:48.754from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:36:40.658 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:40.658 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:40.658 Mar 24 02:36:40.663: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:36:40.663 (5ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:40.663 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:40.663 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:36:40.663 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 02:36:40.668 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:36:44.705 (4.042s) > Enter [It] should execute poststart exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:135 @ 03/24/23 02:36:44.705 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 02:36:44.705 STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 02:36:48.753 [FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc00159b080>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 02:38:48.754 < Exit [It] should execute poststart exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:135 @ 03/24/23 02:38:48.754 (2m4.049s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:48.754 Mar 24 02:38:48.754: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:48.756 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:48.756 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:48.756 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:38:48.756 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:48.756 STEP: Collecting events from namespace "container-lifecycle-hook-7921". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:38:48.756 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:38:48.758 Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:41 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:41 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:42 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:42 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:42 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:42 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:46 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:46 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container pod-with-poststart-exec-hook Mar 24 02:38:48.758: INFO: At 2023-03-24 02:36:46 +0000 UTC - event for pod-with-poststart-exec-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container pod-with-poststart-exec-hook Mar 24 02:38:48.759: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:38:48.759: INFO: pod-handle-http-request tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:40 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:42 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:42 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:40 +0000 UTC }] Mar 24 02:38:48.759: INFO: pod-with-poststart-exec-hook tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:44 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:47 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:47 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:44 +0000 UTC }] Mar 24 02:38:48.759: INFO: Mar 24 02:38:48.761: INFO: Unable to fetch container-lifecycle-hook-7921/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-7921/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 1505; INTERNAL_ERROR; received from peer Mar 24 02:38:48.763: INFO: Unable to fetch container-lifecycle-hook-7921/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-7921/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 1507; INTERNAL_ERROR; received from peer Mar 24 02:38:48.764: INFO: Unable to fetch container-lifecycle-hook-7921/pod-with-poststart-exec-hook/pod-with-poststart-exec-hook logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-7921/pods/pod-with-poststart-exec-hook/log?container=pod-with-poststart-exec-hook&previous=false&tailLines=42": stream error: stream ID 1509; INTERNAL_ERROR; received from peer Mar 24 02:38:48.766: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:48.768: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:38:48.768: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:48.769: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:48.773: INFO: log-pod-2a587d80-ed3c-49c7-b1c3-743d83c86529 started at 2023-03-24 02:38:40 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container logger ready: false, restart count 0 Mar 24 02:38:48.773: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:38:48.773: INFO: busybox-080adf01-5dd2-4eab-b0af-0ae92a626b92 started at 2023-03-24 02:37:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container busybox ready: true, restart count 0 Mar 24 02:38:48.773: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container client-container ready: true, restart count 0 Mar 24 02:38:48.773: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:38:48.773: INFO: log-check-1435f5df-1570-42b4-8e9d-5472e118743c started at 2023-03-24 02:38:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container log-check-1435f5df-1570-42b4-8e9d-5472e118743c ready: false, restart count 0 Mar 24 02:38:48.773: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:38:48.773: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:38:48.773: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:38:48.773: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:38:48.773: INFO: pod-secrets-99839566-1013-4656-8f10-e3c4aed159fb started at 2023-03-24 02:38:16 +0000 UTC (0+3 container statuses recorded) Mar 24 02:38:48.773: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:38:48.773: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:38:48.773: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:38:48.773: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:38:48.773: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:38:48.773: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:38:48.773: INFO: pod-7b383964-2aad-4310-9848-920185ab3df2 started at 2023-03-24 02:38:48 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:48.773: INFO: Container test-container ready: false, restart count 0 W0324 02:38:48.774923 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:38:48.849: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:48.849 (94ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:38:48.849 (94ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:38:48.849 STEP: Destroying namespace "container-lifecycle-hook-7921" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:38:48.849 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:38:48.855 (6ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 120.004s. Expected <*errors.errorString | 0xc0011d60b0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 02:38:54.398from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:36:50.251 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:50.251 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:50.251 Mar 24 02:36:50.265: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:36:50.265 (15ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:50.265 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:50.265 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:36:50.265 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 02:36:50.268 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:36:52.357 (2.092s) > Enter [It] should execute poststart http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:168 @ 03/24/23 02:36:52.357 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 02:36:52.357 STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 02:36:54.393 [FAILED] Timed out after 120.004s. Expected <*errors.errorString | 0xc0011d60b0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 02:38:54.398 < Exit [It] should execute poststart http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:168 @ 03/24/23 02:38:54.398 (2m2.04s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:54.398 Mar 24 02:38:54.398: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:54.404 (6ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:54.404 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:54.404 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:38:54.404 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:54.404 STEP: Collecting events from namespace "container-lifecycle-hook-1570". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:38:54.404 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:38:54.407 Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:51 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:51 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:51 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:51 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:51 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:51 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:53 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:53 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container pod-with-poststart-http-hook Mar 24 02:38:54.407: INFO: At 2023-03-24 02:36:53 +0000 UTC - event for pod-with-poststart-http-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container pod-with-poststart-http-hook Mar 24 02:38:54.409: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:38:54.409: INFO: pod-handle-http-request tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:50 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:51 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:51 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:50 +0000 UTC }] Mar 24 02:38:54.409: INFO: pod-with-poststart-http-hook tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:52 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:53 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:53 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:52 +0000 UTC }] Mar 24 02:38:54.409: INFO: Mar 24 02:38:54.411: INFO: Unable to fetch container-lifecycle-hook-1570/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-1570/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 1645; INTERNAL_ERROR; received from peer Mar 24 02:38:54.413: INFO: Unable to fetch container-lifecycle-hook-1570/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-1570/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 1647; INTERNAL_ERROR; received from peer Mar 24 02:38:54.414: INFO: Unable to fetch container-lifecycle-hook-1570/pod-with-poststart-http-hook/pod-with-poststart-http-hook logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-1570/pods/pod-with-poststart-http-hook/log?container=pod-with-poststart-http-hook&previous=false&tailLines=42": stream error: stream ID 1649; INTERNAL_ERROR; received from peer Mar 24 02:38:54.416: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:54.417: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:38:54.418: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:54.419: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:54.423: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:38:54.423: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:38:54.423: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:38:54.423: INFO: busybox-080adf01-5dd2-4eab-b0af-0ae92a626b92 started at 2023-03-24 02:37:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:54.423: INFO: Container busybox ready: true, restart count 0 Mar 24 02:38:54.423: INFO: downward-api-d8fdac56-c589-4326-847b-c22b468a629c started at 2023-03-24 02:38:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:54.423: INFO: Container dapi-container ready: false, restart count 0 Mar 24 02:38:54.423: INFO: back-off-cap started at 2023-03-24 02:38:48 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:54.423: INFO: Container back-off-cap ready: true, restart count 0 Mar 24 02:38:54.423: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:54.423: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:38:54.423: INFO: pod-secrets-99839566-1013-4656-8f10-e3c4aed159fb started at 2023-03-24 02:38:16 +0000 UTC (0+3 container statuses recorded) Mar 24 02:38:54.423: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:38:54.423: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:38:54.423: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:38:54.423: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:54.423: INFO: Container client-container ready: true, restart count 0 Mar 24 02:38:54.423: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:54.423: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:38:54.423: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:54.423: INFO: Container pod-with-poststart-exec-hook ready: false, restart count 0 W0324 02:38:54.424415 1172 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:38:54.496: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:54.496 (92ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:38:54.496 (92ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:38:54.496 STEP: Destroying namespace "container-lifecycle-hook-1570" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:38:54.496 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:38:54.499 (3ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\spoststart\shttps\shook\sproperly\s\[MinimumKubeletVersion\:1\.23\]\s\[NodeConformance\]$'
[FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc000881050>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 02:34:05.008from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:32:00.936 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:32:00.936 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 02:32:00.936 Mar 24 02:32:00.939: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:32:00.939 (3ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:32:00.939 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:32:00.939 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:32:00.939 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 02:32:00.94 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:32:02.973 (2.034s) > Enter [It] should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:190 @ 03/24/23 02:32:02.973 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 02:32:02.973 STEP: check poststart hook - test/e2e/common/node/lifecycle_hook.go:104 @ 03/24/23 02:32:05.007 [FAILED] Timed out after 120.000s. Expected <*errors.errorString | 0xc000881050>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:113 @ 03/24/23 02:34:05.008 < Exit [It] should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:190 @ 03/24/23 02:34:05.008 (2m2.035s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:05.008 Mar 24 02:34:05.008: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:05.01 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:05.01 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:05.01 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:34:05.01 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:05.01 STEP: Collecting events from namespace "container-lifecycle-hook-1639". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:34:05.01 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:34:05.012 Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:01 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:01 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:01 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:01 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:01 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:02 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:03 +0000 UTC - event for pod-with-poststart-https-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:03 +0000 UTC - event for pod-with-poststart-https-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container pod-with-poststart-https-hook Mar 24 02:34:05.012: INFO: At 2023-03-24 02:32:03 +0000 UTC - event for pod-with-poststart-https-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container pod-with-poststart-https-hook Mar 24 02:34:05.014: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:34:05.014: INFO: pod-handle-http-request tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:00 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:02 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:02 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:00 +0000 UTC }] Mar 24 02:34:05.014: INFO: pod-with-poststart-https-hook tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:02 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:04 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:04 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:32:02 +0000 UTC }] Mar 24 02:34:05.014: INFO: Mar 24 02:34:05.016: INFO: Unable to fetch container-lifecycle-hook-1639/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-1639/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 1015; INTERNAL_ERROR; received from peer Mar 24 02:34:05.018: INFO: Unable to fetch container-lifecycle-hook-1639/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-1639/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 1017; INTERNAL_ERROR; received from peer Mar 24 02:34:05.020: INFO: Unable to fetch container-lifecycle-hook-1639/pod-with-poststart-https-hook/pod-with-poststart-https-hook logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-1639/pods/pod-with-poststart-https-hook/log?container=pod-with-poststart-https-hook&previous=false&tailLines=42": stream error: stream ID 1019; INTERNAL_ERROR; received from peer Mar 24 02:34:05.021: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:05.023: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:34:05.023: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:05.024: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:05.028: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df started at 2023-03-24 02:33:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:05.028: INFO: Container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df ready: true, restart count 0 Mar 24 02:34:05.028: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:05.028: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:05.028: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:05.028: INFO: Container client-container ready: true, restart count 0 Mar 24 02:34:05.028: INFO: pod-handle-http-request started at 2023-03-24 02:32:00 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:05.028: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:34:05.028: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:34:05.028: INFO: deleted-running-always-c4eabc97-c5e7-4b19-badc-7f7aad65519b started at 2023-03-24 02:33:57 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:05.028: INFO: Container deleted-running-always-c4eabc97-c5e7-4b19-badc-7f7aad65519b ready: false, restart count 0 Mar 24 02:34:05.028: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:05.028: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:34:05.028: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:05.028: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:34:05.028: INFO: pod-with-poststart-https-hook started at 2023-03-24 02:32:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:05.028: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 Mar 24 02:34:05.028: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:05.028: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:05.028: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:34:05.028: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:34:05.028: INFO: Container creates-volume-test ready: false, restart count 0 Mar 24 02:34:05.028: INFO: Container dels-volume-test ready: false, restart count 0 Mar 24 02:34:05.028: INFO: Container upds-volume-test ready: false, restart count 0 W0324 02:34:05.029892 1175 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:34:05.112: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:05.112 (101ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:34:05.112 (102ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:34:05.112 STEP: Destroying namespace "container-lifecycle-hook-1639" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:34:05.112 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:34:05.118 (6ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\sexec\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc00138e650>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 02:35:51.821from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:35:09.683 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:35:09.683 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 02:35:09.683 Mar 24 02:35:09.729: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:35:09.729 (45ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:09.729 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:09.729 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:35:09.729 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 02:35:09.739 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:35:15.786 (6.057s) > Enter [It] should execute prestop exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:152 @ 03/24/23 02:35:15.786 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 02:35:15.786 STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 02:35:19.813 STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 02:35:21.82 [FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc00138e650>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 02:35:51.821 < Exit [It] should execute prestop exec hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:152 @ 03/24/23 02:35:51.822 (36.035s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:51.822 Mar 24 02:35:51.822: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:51.824 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:51.824 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:51.824 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:35:51.824 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:51.824 STEP: Collecting events from namespace "container-lifecycle-hook-5665". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:35:51.824 STEP: Found 10 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:35:51.826 Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:13 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:13 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:14 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:14 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:14 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:14 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:16 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:16 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container pod-with-prestop-exec-hook Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:17 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container pod-with-prestop-exec-hook Mar 24 02:35:51.826: INFO: At 2023-03-24 02:35:20 +0000 UTC - event for pod-with-prestop-exec-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Killing: Stopping container pod-with-prestop-exec-hook Mar 24 02:35:51.828: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:35:51.828: INFO: pod-handle-http-request tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:14 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:14 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:09 +0000 UTC }] Mar 24 02:35:51.828: INFO: Mar 24 02:35:51.830: INFO: Unable to fetch container-lifecycle-hook-5665/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-5665/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 1409; INTERNAL_ERROR; received from peer Mar 24 02:35:51.831: INFO: Unable to fetch container-lifecycle-hook-5665/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-5665/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 1411; INTERNAL_ERROR; received from peer Mar 24 02:35:51.833: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:51.834: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:35:51.835: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:51.836: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:51.840: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:51.840: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:35:51.840: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:51.840: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:35:51.840: INFO: busybox-2ac35595-9ff3-4ea2-b8d3-ac4a8a906b18 started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:51.840: INFO: Container busybox ready: false, restart count 0 Mar 24 02:35:51.840: INFO: pod-handle-http-request started at 2023-03-24 02:35:09 +0000 UTC (0+2 container statuses recorded) Mar 24 02:35:51.840: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:35:51.840: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:35:51.840: INFO: container-must-be-restarted started at 2023-03-24 02:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:51.840: INFO: Container regular-1 ready: false, restart count 2 Mar 24 02:35:51.840: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:35:51.840: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:35:51.840: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:35:51.840: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:35:51.840: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:51.840: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:35:51.840: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:51.840: INFO: Container agnhost-container ready: true, restart count 1 Mar 24 02:35:51.840: INFO: pod-projected-configmaps-949b59a1-7546-4c58-94d1-9dfa4ad2c6ed started at 2023-03-24 02:35:50 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:51.840: INFO: Container agnhost-container ready: false, restart count 0 W0324 02:35:51.841520 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:35:51.907: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:51.907 (83ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:35:51.907 (83ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:35:51.907 STEP: Destroying namespace "container-lifecycle-hook-5665" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:35:51.907 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:35:51.911 (4ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\shttp\shook\sproperly\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc00164c6d0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 02:38:29.709from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:37:53.607 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:37:53.607 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 02:37:53.607 Mar 24 02:37:53.618: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:37:53.618 (11ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:53.618 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:53.618 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:37:53.618 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 02:37:53.626 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:37:55.662 (2.044s) > Enter [It] should execute prestop http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:213 @ 03/24/23 02:37:55.662 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 02:37:55.662 STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 02:37:57.686 STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 02:37:59.708 [FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc00164c6d0>: failed to get output for container "container-handle-http-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-http-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 02:38:29.709 < Exit [It] should execute prestop http hook properly [NodeConformance] [Conformance] - test/e2e/common/node/lifecycle_hook.go:213 @ 03/24/23 02:38:29.709 (34.047s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:29.709 Mar 24 02:38:29.709: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:29.712 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:29.712 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:29.712 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:38:29.712 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:29.712 STEP: Collecting events from namespace "container-lifecycle-hook-4249". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:38:29.712 STEP: Found 10 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:38:29.714 Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:54 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:55 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:55 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:55 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:55 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:55 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:56 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:56 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container pod-with-prestop-http-hook Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:56 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container pod-with-prestop-http-hook Mar 24 02:38:29.714: INFO: At 2023-03-24 02:37:57 +0000 UTC - event for pod-with-prestop-http-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Killing: Stopping container pod-with-prestop-http-hook Mar 24 02:38:29.716: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:38:29.716: INFO: pod-handle-http-request tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:53 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:55 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:55 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:53 +0000 UTC }] Mar 24 02:38:29.716: INFO: Mar 24 02:38:29.718: INFO: Unable to fetch container-lifecycle-hook-4249/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-4249/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 1511; INTERNAL_ERROR; received from peer Mar 24 02:38:29.720: INFO: Unable to fetch container-lifecycle-hook-4249/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-4249/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 1513; INTERNAL_ERROR; received from peer Mar 24 02:38:29.721: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:29.723: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:38:29.723: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:29.724: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:29.729: INFO: pod-handle-http-request started at 2023-03-24 02:37:53 +0000 UTC (0+2 container statuses recorded) Mar 24 02:38:29.729: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:38:29.729: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:38:29.729: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:29.729: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:38:29.729: INFO: busybox-080adf01-5dd2-4eab-b0af-0ae92a626b92 started at 2023-03-24 02:37:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:29.729: INFO: Container busybox ready: true, restart count 0 Mar 24 02:38:29.729: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:38:29.729: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:38:29.729: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:38:29.729: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:29.729: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:38:29.729: INFO: pod-secrets-99839566-1013-4656-8f10-e3c4aed159fb started at 2023-03-24 02:38:16 +0000 UTC (0+3 container statuses recorded) Mar 24 02:38:29.729: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:38:29.729: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:38:29.729: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:38:29.729: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:29.729: INFO: Container client-container ready: true, restart count 0 Mar 24 02:38:29.729: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:29.729: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:38:29.729: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:38:29.729: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:38:29.729: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:38:29.729: INFO: graceful-pod-767dd4fc-1dc2-4902-a93f-70899a37cceb-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:37:57 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:29.729: INFO: Container test ready: true, restart count 0 W0324 02:38:29.731156 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:38:29.823: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:29.823 (111ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:38:29.823 (111ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:38:29.823 STEP: Destroying namespace "container-lifecycle-hook-4249" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:38:29.823 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:38:29.825 (3ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainer\sLifecycle\sHook\swhen\screate\sa\spod\swith\slifecycle\shook\sshould\sexecute\sprestop\shttps\shook\sproperly\s\[MinimumKubeletVersion\:1\.23\]\s\[NodeConformance\]$'
[FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc0002ec0e0>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 02:37:23.334from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:36:47.252 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:47.253 STEP: Building a namespace api object, basename container-lifecycle-hook - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:47.253 Mar 24 02:36:47.261: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - set up framework | framework.go:191 @ 03/24/23 02:36:47.261 (9ms) > Enter [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:47.261 < Exit [BeforeEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:47.262 (0s) > Enter [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:36:47.262 STEP: create the container to handle the HTTPGet hook request. - test/e2e/common/node/lifecycle_hook.go:87 @ 03/24/23 02:36:47.266 < Exit [BeforeEach] when create a pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:78 @ 03/24/23 02:36:49.296 (2.034s) > Enter [It] should execute prestop https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:235 @ 03/24/23 02:36:49.296 STEP: create the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:96 @ 03/24/23 02:36:49.296 STEP: delete the pod with lifecycle hook - test/e2e/common/node/lifecycle_hook.go:115 @ 03/24/23 02:36:51.326 STEP: check prestop hook - test/e2e/common/node/lifecycle_hook.go:118 @ 03/24/23 02:36:53.332 [FAILED] Timed out after 30.001s. Expected <*errors.errorString | 0xc0002ec0e0>: failed to get output for container "container-handle-https-request" of pod "pod-handle-http-request" { s: "failed to get output for container \"container-handle-https-request\" of pod \"pod-handle-http-request\"", } to be nil In [It] at: test/e2e/common/node/lifecycle_hook.go:127 @ 03/24/23 02:37:23.334 < Exit [It] should execute prestop https hook properly [MinimumKubeletVersion:1.23] [NodeConformance] - test/e2e/common/node/lifecycle_hook.go:235 @ 03/24/23 02:37:23.334 (34.038s) > Enter [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:23.334 Mar 24 02:37:23.334: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Container Lifecycle Hook - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:23.336 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:23.336 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:23.336 (0s) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:37:23.336 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:23.336 STEP: Collecting events from namespace "container-lifecycle-hook-555". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:37:23.336 STEP: Found 10 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:37:23.338 Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:48 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:48 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-http-request Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:48 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-http-request Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:48 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:48 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container container-handle-https-request Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:48 +0000 UTC - event for pod-handle-http-request: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container container-handle-https-request Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:50 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:50 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container pod-with-prestop-https-hook Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:50 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container pod-with-prestop-https-hook Mar 24 02:37:23.338: INFO: At 2023-03-24 02:36:51 +0000 UTC - event for pod-with-prestop-https-hook: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Killing: Stopping container pod-with-prestop-https-hook Mar 24 02:37:23.339: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:37:23.339: INFO: pod-handle-http-request tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:47 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:48 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:48 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:47 +0000 UTC }] Mar 24 02:37:23.339: INFO: Mar 24 02:37:23.341: INFO: Unable to fetch container-lifecycle-hook-555/pod-handle-http-request/container-handle-http-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-555/pods/pod-handle-http-request/log?container=container-handle-http-request&previous=false&tailLines=42": stream error: stream ID 1373; INTERNAL_ERROR; received from peer Mar 24 02:37:23.343: INFO: Unable to fetch container-lifecycle-hook-555/pod-handle-http-request/container-handle-https-request logs: Get "https://127.0.0.1:6443/api/v1/namespaces/container-lifecycle-hook-555/pods/pod-handle-http-request/log?container=container-handle-https-request&previous=false&tailLines=42": stream error: stream ID 1375; INTERNAL_ERROR; received from peer Mar 24 02:37:23.344: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:23.346: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:37:23.346: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:23.347: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:23.352: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.352: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:37:23.352: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.352: INFO: Container client-container ready: true, restart count 0 Mar 24 02:37:23.352: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.352: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:37:23.352: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:23.352: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:23.352: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:23.352: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.352: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:37:23.352: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.352: INFO: Container agnhost-container ready: false, restart count 4 Mar 24 02:37:23.352: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:23.352: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:23.352: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:23.352: INFO: pod-handle-http-request started at 2023-03-24 02:36:47 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:23.352: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:23.352: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:23.352: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:37:23.352: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:37:23.352: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:37:23.352: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:37:23.352: INFO: pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205 started at 2023-03-24 02:37:21 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.352: INFO: Container main ready: true, restart count 0 W0324 02:37:23.353303 1175 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:37:23.432: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:23.432 (97ms) < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - dump namespaces | framework.go:209 @ 03/24/23 02:37:23.432 (97ms) > Enter [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:37:23.432 STEP: Destroying namespace "container-lifecycle-hook-555" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:37:23.432 < Exit [DeferCleanup (Each)] [sig-node] Container Lifecycle Hook - tear down framework | framework.go:206 @ 03/24/23 02:37:23.435 (3ms)
Find pod-handle-http-request mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\sarguments\s\(container\scmd\)\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-6362/pods/client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6/log?container=agnhost-container&previous=false": stream error: stream ID 23; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:42.085from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:26:29.814 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:26:29.814 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 02:26:29.814 Mar 24 02:26:29.856: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:26:29.856 (41ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:29.856 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:29.856 (0s) > Enter [It] should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:61 @ 03/24/23 02:26:29.856 STEP: Creating a pod to test override arguments - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:26:29.856 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:26:41.998 Mar 24 02:26:41.999: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6 container agnhost-container: <nil> Mar 24 02:26:42.005: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/containers-6362/pods/client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6/log?container=agnhost-container&previous=false": stream error: stream ID 23; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:26:42.005 Mar 24 02:26:42.081: INFO: Unexpected error: <*fmt.wrapError | 0xc0000b7f20>: failed to get logs from client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-6362/pods/client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6/log?container=agnhost-container&previous=false": stream error: stream ID 23; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/containers-6362/pods/client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6/log?container=agnhost-container&previous=false\": stream error: stream ID 23; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001194e70>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-6362/pods/client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 23, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-6362/pods/client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6/log?container=agnhost-container&previous=false": stream error: stream ID 23; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:42.085 < Exit [It] should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:61 @ 03/24/23 02:26:42.085 (12.229s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:42.085 Mar 24 02:26:42.085: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:42.111 (25ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:42.111 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:42.111 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:26:42.111 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:42.111 STEP: Collecting events from namespace "containers-6362". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:26:42.111 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:26:42.131 Mar 24 02:26:42.131: INFO: At 2023-03-24 02:26:36 +0000 UTC - event for client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:26:42.131: INFO: At 2023-03-24 02:26:37 +0000 UTC - event for client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:26:42.131: INFO: At 2023-03-24 02:26:38 +0000 UTC - event for client-containers-47f89a88-b1c9-4c9d-9799-790e290818d6: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:26:42.162: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:26:42.162: INFO: Mar 24 02:26:42.175: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:42.187: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 86 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:29 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:26:42.187: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:42.211: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:42.223: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.223: INFO: Container back-off ready: true, restart count 0 Mar 24 02:26:42.223: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.223: INFO: Container client-container ready: true, restart count 0 Mar 24 02:26:42.223: INFO: pod58adf7cd-4828-42b8-a5ed-9cea0cc6f487 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.223: INFO: Container containerad81c6b1-3fd8-40bc-94d9-7e998c87e7e0 ready: false, restart count 0 Mar 24 02:26:42.223: INFO: termination-message-container900e0768-2c53-49c2-9916-d93aee5cce1d started at 2023-03-24 02:26:41 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.223: INFO: Container termination-message-container ready: false, restart count 0 Mar 24 02:26:42.223: INFO: deleted-running-always-25cfff4e-6dbd-4272-8185-1168c6b7b044 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.223: INFO: Container deleted-running-always-25cfff4e-6dbd-4272-8185-1168c6b7b044 ready: true, restart count 0 W0324 02:26:42.232525 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:26:45.047: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:45.047 (2.936s) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:26:45.049 (2.938s) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:26:45.049 STEP: Destroying namespace "containers-6362" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:26:45.05 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:26:45.115 (66ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\s\(container\sentrypoint\)\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-e849f41c-2c20-45ca-aad7-56355cbea239 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-2952/pods/client-containers-e849f41c-2c20-45ca-aad7-56355cbea239/log?container=agnhost-container&previous=false": stream error: stream ID 1207; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:40.28from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:36:36.24 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:36.24 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:36.241 Mar 24 02:36:36.243: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:36:36.243 (3ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:36.243 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:36.244 (0s) > Enter [It] should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:75 @ 03/24/23 02:36:36.244 STEP: Creating a pod to test override command - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:36:36.244 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:36:40.271 Mar 24 02:36:40.273: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod client-containers-e849f41c-2c20-45ca-aad7-56355cbea239 container agnhost-container: <nil> Mar 24 02:36:40.275: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "client-containers-e849f41c-2c20-45ca-aad7-56355cbea239" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/containers-2952/pods/client-containers-e849f41c-2c20-45ca-aad7-56355cbea239/log?container=agnhost-container&previous=false": stream error: stream ID 1207; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:36:40.275 Mar 24 02:36:40.280: INFO: Unexpected error: <*fmt.wrapError | 0xc000ab4cc0>: failed to get logs from client-containers-e849f41c-2c20-45ca-aad7-56355cbea239 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-2952/pods/client-containers-e849f41c-2c20-45ca-aad7-56355cbea239/log?container=agnhost-container&previous=false": stream error: stream ID 1207; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-e849f41c-2c20-45ca-aad7-56355cbea239 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/containers-2952/pods/client-containers-e849f41c-2c20-45ca-aad7-56355cbea239/log?container=agnhost-container&previous=false\": stream error: stream ID 1207; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0010af470>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-2952/pods/client-containers-e849f41c-2c20-45ca-aad7-56355cbea239/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1207, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-e849f41c-2c20-45ca-aad7-56355cbea239 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-2952/pods/client-containers-e849f41c-2c20-45ca-aad7-56355cbea239/log?container=agnhost-container&previous=false": stream error: stream ID 1207; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:40.28 < Exit [It] should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:75 @ 03/24/23 02:36:40.28 (4.037s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:40.28 Mar 24 02:36:40.280: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:40.282 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:40.282 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:40.282 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:36:40.282 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:40.282 STEP: Collecting events from namespace "containers-2952". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:40.282 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:40.284 Mar 24 02:36:40.284: INFO: At 2023-03-24 02:36:37 +0000 UTC - event for client-containers-e849f41c-2c20-45ca-aad7-56355cbea239: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:36:40.284: INFO: At 2023-03-24 02:36:37 +0000 UTC - event for client-containers-e849f41c-2c20-45ca-aad7-56355cbea239: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:36:40.284: INFO: At 2023-03-24 02:36:37 +0000 UTC - event for client-containers-e849f41c-2c20-45ca-aad7-56355cbea239: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:36:40.285: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:40.285: INFO: Mar 24 02:36:40.287: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:40.288: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:40.288: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:40.290: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:40.293: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:40.293: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:40.293: INFO: busybox-770178eb-3a40-4ab9-8b9f-3e9983310254 started at 2023-03-24 02:36:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container busybox ready: true, restart count 0 Mar 24 02:36:40.293: INFO: bin-false740fb158-0f7a-4090-b794-cc57f76b2fce started at 2023-03-24 02:36:36 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container bin-false740fb158-0f7a-4090-b794-cc57f76b2fce ready: false, restart count 0 Mar 24 02:36:40.293: INFO: liveness-1dfd5b3c-153f-4cfd-9a45-00a379ca7af9 started at 2023-03-24 02:36:25 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:36:40.293: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:40.293: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:40.293: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:40.293: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:36:40.293: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:36:40.293: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container agnhost-container ready: true, restart count 3 Mar 24 02:36:40.293: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:40.293: INFO: Container busybox-container ready: true, restart count 1 W0324 02:36:40.295054 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:40.647: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:40.647 (365ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:36:40.647 (365ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:36:40.647 STEP: Destroying namespace "containers-2952" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:40.648 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:36:40.652 (5ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\sbe\sable\sto\soverride\sthe\simage\'s\sdefault\scommand\sand\sarguments\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-7531/pods/client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba/log?container=agnhost-container&previous=false": stream error: stream ID 617; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:02.382from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:34:58.311 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:34:58.311 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 02:34:58.311 Mar 24 02:34:58.315: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:34:58.315 (3ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:58.315 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:58.315 (0s) > Enter [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:89 @ 03/24/23 02:34:58.315 STEP: Creating a pod to test override all - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:34:58.315 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:35:02.35 Mar 24 02:35:02.355: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba container agnhost-container: <nil> Mar 24 02:35:02.362: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/containers-7531/pods/client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba/log?container=agnhost-container&previous=false": stream error: stream ID 617; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:35:02.362 Mar 24 02:35:02.382: INFO: Unexpected error: <*fmt.wrapError | 0xc000b59220>: failed to get logs from client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-7531/pods/client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba/log?container=agnhost-container&previous=false": stream error: stream ID 617; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/containers-7531/pods/client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba/log?container=agnhost-container&previous=false\": stream error: stream ID 617; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000fe41b0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-7531/pods/client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 617, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-7531/pods/client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba/log?container=agnhost-container&previous=false": stream error: stream ID 617; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:02.382 < Exit [It] should be able to override the image's default command and arguments [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:89 @ 03/24/23 02:35:02.382 (4.067s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:02.382 Mar 24 02:35:02.382: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:02.387 (5ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:02.387 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:02.387 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:35:02.387 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:02.387 STEP: Collecting events from namespace "containers-7531". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:35:02.387 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:35:02.393 Mar 24 02:35:02.393: INFO: At 2023-03-24 02:34:59 +0000 UTC - event for client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:35:02.393: INFO: At 2023-03-24 02:34:59 +0000 UTC - event for client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:35:02.393: INFO: At 2023-03-24 02:34:59 +0000 UTC - event for client-containers-0b4a7cbf-b6f3-441f-9a55-41c1f871daba: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:35:02.398: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:35:02.398: INFO: Mar 24 02:35:02.403: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:02.416: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:35:02.416: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:02.425: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:02.435: INFO: static-pod-b4a4dc5a-1994-4a27-a3e3-a2c5eaafaf17-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:34:57 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:02.435: INFO: Container test ready: true, restart count 0 Mar 24 02:35:02.435: INFO: static-pod-f3de9564-0369-4a2e-a776-2930fbc4275a-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:35:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:02.435: INFO: Container test ready: false, restart count 0 Mar 24 02:35:02.435: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:02.435: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 02:35:02.435: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:02.435: INFO: Container client-container ready: false, restart count 0 Mar 24 02:35:02.435: INFO: downwardapi-volume-90014877-4e7b-4414-8d3f-e43a758c603d started at 2023-03-24 02:34:59 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:02.435: INFO: Container client-container ready: false, restart count 0 Mar 24 02:35:02.435: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:35:02.435: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:35:02.435: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:35:02.435: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:35:02.435: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:02.435: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:35:02.435: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:02.435: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 W0324 02:35:02.438791 1163 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:35:03.286: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:03.286 (900ms) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:35:03.286 (900ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:35:03.287 STEP: Destroying namespace "containers-7531" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:35:03.287 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:35:03.292 (6ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sContainers\sshould\suse\sthe\simage\sdefaults\sif\scommand\sand\sargs\sare\sblank\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 3.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc000b8d890>: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-1103/pods/client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64/log?container=agnhost-container&previous=false": stream error: stream ID 1353; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-1103/pods/client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1353, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/node/containers.go:53 @ 03/24/23 02:36:48.425from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:36:43.394 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:43.394 STEP: Building a namespace api object, basename containers - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:43.394 Mar 24 02:36:43.397: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Containers - set up framework | framework.go:191 @ 03/24/23 02:36:43.397 (3ms) > Enter [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:43.397 < Exit [BeforeEach] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:43.397 (0s) > Enter [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:41 @ 03/24/23 02:36:43.397 [FAILED] Timed out after 3.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc000b8d890>: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-1103/pods/client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64/log?container=agnhost-container&previous=false": stream error: stream ID 1353; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/containers-1103/pods/client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1353, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/node/containers.go:53 @ 03/24/23 02:36:48.425 < Exit [It] should use the image defaults if command and args are blank [NodeConformance] [Conformance] - test/e2e/common/node/containers.go:41 @ 03/24/23 02:36:48.425 (5.027s) > Enter [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:48.425 Mar 24 02:36:48.425: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Containers - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:48.427 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:48.427 < Exit [DeferCleanup (Each)] [sig-node] Containers - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:48.427 (0s) > Enter [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:36:48.427 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:48.427 STEP: Collecting events from namespace "containers-1103". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:48.427 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:48.429 Mar 24 02:36:48.429: INFO: At 2023-03-24 02:36:44 +0000 UTC - event for client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:36:48.429: INFO: At 2023-03-24 02:36:44 +0000 UTC - event for client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:36:48.429: INFO: At 2023-03-24 02:36:44 +0000 UTC - event for client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:36:48.430: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:48.430: INFO: client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:43 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:44 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:44 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:36:43 +0000 UTC }] Mar 24 02:36:48.430: INFO: Mar 24 02:36:48.432: INFO: Unable to fetch containers-1103/client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/containers-1103/pods/client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 1361; INTERNAL_ERROR; received from peer Mar 24 02:36:48.434: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:48.436: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:48.436: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:48.438: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:48.443: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:48.443: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container agnhost-container ready: true, restart count 3 Mar 24 02:36:48.443: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:36:48.443: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:36:48.443: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:36:48.443: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:36:48.443: INFO: client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64 started at 2023-03-24 02:36:43 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:36:48.443: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:48.443: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:48.443: INFO: hostfqdn-197718 started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container test-container ready: false, restart count 0 Mar 24 02:36:48.443: INFO: busybox-770178eb-3a40-4ab9-8b9f-3e9983310254 started at 2023-03-24 02:36:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.443: INFO: Container busybox ready: true, restart count 0 Mar 24 02:36:48.443: INFO: pod-handle-http-request started at 2023-03-24 02:36:47 +0000 UTC (0+2 container statuses recorded) Mar 24 02:36:48.443: INFO: Container container-handle-http-request ready: false, restart count 0 Mar 24 02:36:48.443: INFO: Container container-handle-https-request ready: false, restart count 0 Mar 24 02:36:48.443: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:48.443: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:48.443: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:48.443: INFO: Container updcm-volume-test ready: true, restart count 0 W0324 02:36:48.446010 1172 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:50.225: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:50.225 (1.798s) < Exit [DeferCleanup (Each)] [sig-node] Containers - dump namespaces | framework.go:209 @ 03/24/23 02:36:50.225 (1.798s) > Enter [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:36:50.225 STEP: Destroying namespace "containers-1103" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:50.225 < Exit [DeferCleanup (Each)] [sig-node] Containers - tear down framework | framework.go:206 @ 03/24/23 02:36:50.245 (20ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\scontainer\'s\slimits\.cpu\/memory\sand\srequests\.cpu\/memory\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-d8fdac56-c589-4326-847b-c22b468a629c for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7533/pods/downward-api-d8fdac56-c589-4326-847b-c22b468a629c/log?container=dapi-container&previous=false": stream error: stream ID 1881; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:38:56.739from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:38:52.681 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:38:52.681 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:38:52.681 Mar 24 02:38:52.685: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:38:52.685 (4ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:38:52.685 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:38:52.685 (0s) > Enter [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:167 @ 03/24/23 02:38:52.685 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:38:52.685 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:38:56.722 Mar 24 02:38:56.725: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downward-api-d8fdac56-c589-4326-847b-c22b468a629c container dapi-container: <nil> Mar 24 02:38:56.731: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downward-api-d8fdac56-c589-4326-847b-c22b468a629c" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7533/pods/downward-api-d8fdac56-c589-4326-847b-c22b468a629c/log?container=dapi-container&previous=false": stream error: stream ID 1881; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:38:56.731 Mar 24 02:38:56.738: INFO: Unexpected error: <*fmt.wrapError | 0xc001609300>: failed to get logs from downward-api-d8fdac56-c589-4326-847b-c22b468a629c for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7533/pods/downward-api-d8fdac56-c589-4326-847b-c22b468a629c/log?container=dapi-container&previous=false": stream error: stream ID 1881; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-d8fdac56-c589-4326-847b-c22b468a629c for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-7533/pods/downward-api-d8fdac56-c589-4326-847b-c22b468a629c/log?container=dapi-container&previous=false\": stream error: stream ID 1881; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00111fa40>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7533/pods/downward-api-d8fdac56-c589-4326-847b-c22b468a629c/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1881, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-d8fdac56-c589-4326-847b-c22b468a629c for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-7533/pods/downward-api-d8fdac56-c589-4326-847b-c22b468a629c/log?container=dapi-container&previous=false": stream error: stream ID 1881; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:38:56.739 < Exit [It] should provide container's limits.cpu/memory and requests.cpu/memory as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:167 @ 03/24/23 02:38:56.739 (4.054s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:56.739 Mar 24 02:38:56.739: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:38:56.74 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:56.74 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:38:56.74 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:38:56.74 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:56.74 STEP: Collecting events from namespace "downward-api-7533". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:38:56.74 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:38:56.742 Mar 24 02:38:56.742: INFO: At 2023-03-24 02:38:53 +0000 UTC - event for downward-api-d8fdac56-c589-4326-847b-c22b468a629c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:38:56.742: INFO: At 2023-03-24 02:38:53 +0000 UTC - event for downward-api-d8fdac56-c589-4326-847b-c22b468a629c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:38:56.742: INFO: At 2023-03-24 02:38:53 +0000 UTC - event for downward-api-d8fdac56-c589-4326-847b-c22b468a629c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:38:56.743: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:38:56.743: INFO: Mar 24 02:38:56.744: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:56.745: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:38:56.745: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:56.747: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:38:56.752: INFO: back-off-cap started at 2023-03-24 02:38:48 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:56.752: INFO: Container back-off-cap ready: false, restart count 0 Mar 24 02:38:56.752: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:56.752: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:38:56.752: INFO: busybox-080adf01-5dd2-4eab-b0af-0ae92a626b92 started at 2023-03-24 02:37:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:56.752: INFO: Container busybox ready: true, restart count 0 Mar 24 02:38:56.752: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:56.752: INFO: Container client-container ready: true, restart count 0 Mar 24 02:38:56.752: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:56.752: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:38:56.752: INFO: pod-secrets-99839566-1013-4656-8f10-e3c4aed159fb started at 2023-03-24 02:38:16 +0000 UTC (0+3 container statuses recorded) Mar 24 02:38:56.752: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:38:56.752: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:38:56.752: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:38:56.752: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:38:56.752: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:38:56.752: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:38:56.752: INFO: downwardapi-volume-75ad5a41-1096-48c4-8e86-f41b0fa110d1 started at 2023-03-24 02:38:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:38:56.752: INFO: Container client-container ready: false, restart count 0 W0324 02:38:56.753587 1160 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:38:56.855: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:38:56.855 (115ms) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:38:56.855 (115ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:38:56.855 STEP: Destroying namespace "downward-api-7533" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:38:56.855 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:38:56.862 (7ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\sdefault\slimits\.cpu\/memory\sfrom\snode\sallocatable\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9996/pods/downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4/log?container=dapi-container&previous=false": stream error: stream ID 1545; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:37:55.241from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:37:51.14 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:37:51.14 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:37:51.14 Mar 24 02:37:51.166: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:37:51.166 (26ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:51.166 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:51.166 (0s) > Enter [It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:218 @ 03/24/23 02:37:51.166 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:37:51.166 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:37:55.217 Mar 24 02:37:55.220: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4 container dapi-container: <nil> Mar 24 02:37:55.222: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9996/pods/downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4/log?container=dapi-container&previous=false": stream error: stream ID 1545; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:37:55.222 Mar 24 02:37:55.241: INFO: Unexpected error: <*fmt.wrapError | 0xc00062d700>: failed to get logs from downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9996/pods/downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4/log?container=dapi-container&previous=false": stream error: stream ID 1545; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-9996/pods/downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4/log?container=dapi-container&previous=false\": stream error: stream ID 1545; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001119320>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9996/pods/downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1545, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9996/pods/downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4/log?container=dapi-container&previous=false": stream error: stream ID 1545; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:37:55.241 < Exit [It] should provide default limits.cpu/memory from node allocatable [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:218 @ 03/24/23 02:37:55.241 (4.076s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:55.241 Mar 24 02:37:55.241: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:55.246 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:55.246 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:55.246 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:37:55.246 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:55.246 STEP: Collecting events from namespace "downward-api-9996". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:37:55.246 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:37:55.25 Mar 24 02:37:55.250: INFO: At 2023-03-24 02:37:52 +0000 UTC - event for downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:37:55.250: INFO: At 2023-03-24 02:37:52 +0000 UTC - event for downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:37:55.250: INFO: At 2023-03-24 02:37:52 +0000 UTC - event for downward-api-06c05c32-f484-43f1-b403-11a4b2a5f1f4: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:37:55.252: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:37:55.252: INFO: Mar 24 02:37:55.257: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:55.258: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:37:55.259: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:55.262: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:55.270: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:37:55.270: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:55.270: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:55.270: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:55.270: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:37:55.270: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container client-container ready: true, restart count 0 Mar 24 02:37:55.270: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:55.270: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:55.270: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:55.270: INFO: poda9e17563-0d75-4ed2-9afd-e1b4bde95fec started at 2023-03-24 02:37:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container container7b85f820-bf9e-4089-b07c-2165a22761db ready: false, restart count 0 Mar 24 02:37:55.270: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:37:55.270: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:37:55.270: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:37:55.270: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:37:55.270: INFO: pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205 started at 2023-03-24 02:37:21 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container main ready: true, restart count 0 Mar 24 02:37:55.270: INFO: pod-handle-http-request started at 2023-03-24 02:37:53 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:55.270: INFO: Container container-handle-http-request ready: false, restart count 0 Mar 24 02:37:55.270: INFO: Container container-handle-https-request ready: false, restart count 0 Mar 24 02:37:55.270: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:37:55.270: INFO: busybox-080adf01-5dd2-4eab-b0af-0ae92a626b92 started at 2023-03-24 02:37:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container busybox ready: false, restart count 0 Mar 24 02:37:55.270: INFO: pod739403d9-a4a5-4857-bfc9-731784a5252c started at 2023-03-24 02:37:49 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:55.270: INFO: Container containerf5809eb6-4cbd-45ae-8c2b-5ebc13fdb860 ready: false, restart count 0 W0324 02:37:55.276942 1160 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:37:57.352: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:57.353 (2.107s) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:37:57.353 (2.107s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:37:57.353 STEP: Destroying namespace "downward-api-9996" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:37:57.353 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:37:57.356 (4ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\shost\sIP\sas\san\senv\svar\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-8255/pods/downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a/log?container=dapi-container&previous=false": stream error: stream ID 49; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:48.559from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:26:44.509 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:26:44.51 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:26:44.51 Mar 24 02:26:44.515: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:26:44.515 (5ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:44.515 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:44.515 (0s) > Enter [It] should provide host IP as an env var [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:91 @ 03/24/23 02:26:44.515 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:26:44.515 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:26:48.548 Mar 24 02:26:48.550: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a container dapi-container: <nil> Mar 24 02:26:48.552: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-8255/pods/downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a/log?container=dapi-container&previous=false": stream error: stream ID 49; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:26:48.552 Mar 24 02:26:48.559: INFO: Unexpected error: <*fmt.wrapError | 0xc0003c2e00>: failed to get logs from downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-8255/pods/downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a/log?container=dapi-container&previous=false": stream error: stream ID 49; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-8255/pods/downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a/log?container=dapi-container&previous=false\": stream error: stream ID 49; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000ad55f0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-8255/pods/downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 49, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-8255/pods/downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a/log?container=dapi-container&previous=false": stream error: stream ID 49; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:48.559 < Exit [It] should provide host IP as an env var [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:91 @ 03/24/23 02:26:48.559 (4.045s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:48.559 Mar 24 02:26:48.559: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:48.562 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:48.562 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:48.562 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:26:48.562 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:48.562 STEP: Collecting events from namespace "downward-api-8255". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:26:48.562 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:26:48.565 Mar 24 02:26:48.565: INFO: At 2023-03-24 02:26:45 +0000 UTC - event for downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:26:48.565: INFO: At 2023-03-24 02:26:45 +0000 UTC - event for downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:26:48.565: INFO: At 2023-03-24 02:26:46 +0000 UTC - event for downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:26:48.566: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:26:48.566: INFO: Mar 24 02:26:48.567: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:48.569: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 86 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:29 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:26:48.569: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:48.570: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:48.576: INFO: isolated-pid-ns-test-pod started at 2023-03-24 02:26:45 +0000 UTC (0+2 container statuses recorded) Mar 24 02:26:48.576: INFO: Container test-container-1 ready: false, restart count 0 Mar 24 02:26:48.576: INFO: Container test-container-2 ready: false, restart count 0 Mar 24 02:26:48.576: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:48.576: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 02:26:48.576: INFO: pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362 started at 2023-03-24 02:26:46 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:48.576: INFO: Container configmap-volume-test ready: false, restart count 0 Mar 24 02:26:48.576: INFO: alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 started at 2023-03-24 02:26:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:48.576: INFO: Container alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 ready: false, restart count 0 Mar 24 02:26:48.576: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:48.576: INFO: Container back-off ready: true, restart count 1 Mar 24 02:26:48.576: INFO: pod-init-ada877c6-8b63-4d79-ade0-56ee2c9018dc started at 2023-03-24 02:26:45 +0000 UTC (2+1 container statuses recorded) Mar 24 02:26:48.576: INFO: Init container init1 ready: false, restart count 1 Mar 24 02:26:48.576: INFO: Init container init2 ready: false, restart count 0 Mar 24 02:26:48.576: INFO: Container run1 ready: false, restart count 0 Mar 24 02:26:48.576: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:48.576: INFO: Container client-container ready: true, restart count 0 Mar 24 02:26:48.576: INFO: pod-hostip-6fd5cd29-9069-4e48-88e0-1e449a4d3a20 started at 2023-03-24 02:26:48 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:48.576: INFO: Container test ready: false, restart count 0 W0324 02:26:48.577619 1160 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:26:51.307: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:51.307 (2.745s) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:26:51.307 (2.745s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:26:51.307 STEP: Destroying namespace "downward-api-8255" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:26:51.307 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:26:51.315 (8ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\spod\sUID\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3244/pods/downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1/log?container=dapi-container&previous=false": stream error: stream ID 89; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:55.396from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:26:51.317 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:26:51.317 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:26:51.317 Mar 24 02:26:51.323: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:26:51.323 (6ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:51.323 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:51.323 (0s) > Enter [It] should provide pod UID as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:268 @ 03/24/23 02:26:51.323 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:26:51.323 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:26:55.385 Mar 24 02:26:55.387: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1 container dapi-container: <nil> Mar 24 02:26:55.389: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3244/pods/downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1/log?container=dapi-container&previous=false": stream error: stream ID 89; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:26:55.389 Mar 24 02:26:55.396: INFO: Unexpected error: <*fmt.wrapError | 0xc000b120e0>: failed to get logs from downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3244/pods/downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1/log?container=dapi-container&previous=false": stream error: stream ID 89; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-3244/pods/downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1/log?container=dapi-container&previous=false\": stream error: stream ID 89; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0011b4570>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3244/pods/downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 89, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-3244/pods/downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1/log?container=dapi-container&previous=false": stream error: stream ID 89; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:55.396 < Exit [It] should provide pod UID as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:268 @ 03/24/23 02:26:55.396 (4.073s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:55.396 Mar 24 02:26:55.396: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:55.398 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:55.398 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:55.398 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:26:55.398 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:55.398 STEP: Collecting events from namespace "downward-api-3244". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:26:55.398 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:26:55.4 Mar 24 02:26:55.400: INFO: At 2023-03-24 02:26:52 +0000 UTC - event for downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:26:55.400: INFO: At 2023-03-24 02:26:52 +0000 UTC - event for downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:26:55.400: INFO: At 2023-03-24 02:26:52 +0000 UTC - event for downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:26:55.401: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:26:55.401: INFO: Mar 24 02:26:55.402: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:55.404: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 86 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:29 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:26:55.404: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:55.405: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:55.409: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Container client-container ready: true, restart count 0 Mar 24 02:26:55.409: INFO: pod-hostip-6fd5cd29-9069-4e48-88e0-1e449a4d3a20 started at 2023-03-24 02:26:48 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Container test ready: true, restart count 0 Mar 24 02:26:55.409: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Container back-off ready: false, restart count 1 Mar 24 02:26:55.409: INFO: pod-init-ada877c6-8b63-4d79-ade0-56ee2c9018dc started at 2023-03-24 02:26:45 +0000 UTC (2+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Init container init1 ready: false, restart count 1 Mar 24 02:26:55.409: INFO: Init container init2 ready: false, restart count 0 Mar 24 02:26:55.409: INFO: Container run1 ready: false, restart count 0 Mar 24 02:26:55.409: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:26:55.409: INFO: downwardapi-volume-dbcebff3-7a04-49a2-bb99-c7c015d2b894 started at 2023-03-24 02:26:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Container client-container ready: false, restart count 0 Mar 24 02:26:55.409: INFO: initcontainer-test-pod-with-post-start started at 2023-03-24 02:26:54 +0000 UTC (1+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Init container init-1 ready: false, restart count 0 Mar 24 02:26:55.409: INFO: Container regular-1 ready: false, restart count 0 Mar 24 02:26:55.409: INFO: isolated-pid-ns-test-pod started at 2023-03-24 02:26:45 +0000 UTC (0+2 container statuses recorded) Mar 24 02:26:55.409: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 02:26:55.409: INFO: Container test-container-2 ready: true, restart count 0 Mar 24 02:26:55.409: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:55.409: INFO: Container agnhost-container ready: true, restart count 0 W0324 02:26:55.417866 1160 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:26:57.636: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:57.636 (2.238s) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:26:57.655 (2.257s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:26:57.655 STEP: Destroying namespace "downward-api-3244" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:26:57.656 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:26:57.687 (32ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sDownward\sAPI\sshould\sprovide\spod\sname\,\snamespace\sand\sIP\saddress\sas\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5999/pods/downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745/log?container=dapi-container&previous=false": stream error: stream ID 1193; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:20.611from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:35:16.532 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:35:16.532 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:35:16.532 Mar 24 02:35:16.537: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Downward API - set up framework | framework.go:191 @ 03/24/23 02:35:16.537 (5ms) > Enter [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:16.537 < Exit [BeforeEach] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:16.537 (0s) > Enter [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:45 @ 03/24/23 02:35:16.537 STEP: Creating a pod to test downward api env vars - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:35:16.537 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:35:20.597 Mar 24 02:35:20.599: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745 container dapi-container: <nil> Mar 24 02:35:20.601: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5999/pods/downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745/log?container=dapi-container&previous=false": stream error: stream ID 1193; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:35:20.601 Mar 24 02:35:20.611: INFO: Unexpected error: <*fmt.wrapError | 0xc001a0a140>: failed to get logs from downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5999/pods/downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745/log?container=dapi-container&previous=false": stream error: stream ID 1193; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-5999/pods/downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745/log?container=dapi-container&previous=false\": stream error: stream ID 1193; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0019fea20>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5999/pods/downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1193, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-5999/pods/downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745/log?container=dapi-container&previous=false": stream error: stream ID 1193; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:20.611 < Exit [It] should provide pod name, namespace and IP address as env vars [NodeConformance] [Conformance] - test/e2e/common/node/downwardapi.go:45 @ 03/24/23 02:35:20.611 (4.074s) > Enter [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:20.611 Mar 24 02:35:20.611: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Downward API - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:20.614 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:20.614 < Exit [DeferCleanup (Each)] [sig-node] Downward API - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:20.614 (0s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:35:20.614 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:20.614 STEP: Collecting events from namespace "downward-api-5999". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:35:20.614 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:35:20.615 Mar 24 02:35:20.615: INFO: At 2023-03-24 02:35:17 +0000 UTC - event for downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:35:20.615: INFO: At 2023-03-24 02:35:17 +0000 UTC - event for downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:35:20.615: INFO: At 2023-03-24 02:35:17 +0000 UTC - event for downward-api-74c51e10-9d9c-4ae2-8c8a-0addbb0d1745: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:35:20.618: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:35:20.618: INFO: Mar 24 02:35:20.620: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:20.634: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:35:20.634: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:20.636: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:20.649: INFO: pod-with-prestop-exec-hook started at 2023-03-24 02:35:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container pod-with-prestop-exec-hook ready: true, restart count 0 Mar 24 02:35:20.649: INFO: busybox-2ac35595-9ff3-4ea2-b8d3-ac4a8a906b18 started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container busybox ready: false, restart count 0 Mar 24 02:35:20.649: INFO: pod-handle-http-request started at 2023-03-24 02:35:09 +0000 UTC (0+2 container statuses recorded) Mar 24 02:35:20.649: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:35:20.649: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:35:20.649: INFO: pod-projected-secrets-a2f0d7cb-ff22-4cdf-8827-df451b308447 started at 2023-03-24 02:35:19 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container projected-secret-volume-test ready: false, restart count 0 Mar 24 02:35:20.649: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:35:20.649: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:35:20.649: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:35:20.649: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:35:20.649: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:35:20.649: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:35:20.649: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container client-container ready: false, restart count 0 Mar 24 02:35:20.649: INFO: static-pod-f3de9564-0369-4a2e-a776-2930fbc4275a-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:35:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container test ready: true, restart count 1 Mar 24 02:35:20.649: INFO: pod-75b788f6-4452-4432-b481-073dc43243be started at 2023-03-24 02:35:19 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:20.649: INFO: Container test-container ready: false, restart count 0 W0324 02:35:20.656927 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:35:22.833: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:22.833 (2.22s) < Exit [DeferCleanup (Each)] [sig-node] Downward API - dump namespaces | framework.go:209 @ 03/24/23 02:35:22.833 (2.22s) > Enter [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:35:22.833 STEP: Destroying namespace "downward-api-5999" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:35:22.833 < Exit [DeferCleanup (Each)] [sig-node] Downward API - tear down framework | framework.go:206 @ 03/24/23 02:35:22.836 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sEphemeral\sContainers\s\[NodeConformance\]\swill\sstart\san\sephemeral\scontainer\sin\san\sexisting\spod\s\[Conformance\]$'
[FAILED] Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-7168(61380093-cbc9-4ab6-8e96-145b7f925ca0)" ephemeral container "debugger": Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-7168/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 815; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/ephemeral_containers.go:81 @ 03/24/23 02:34:13.439from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:34:09.261 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:34:09.261 STEP: Building a namespace api object, basename ephemeral-containers-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:34:09.261 Mar 24 02:34:09.270: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:34:09.27 (9ms) > Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:09.27 < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:09.27 (0s) > Enter [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/common/node/ephemeral_containers.go:39 @ 03/24/23 02:34:09.27 < Exit [BeforeEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/common/node/ephemeral_containers.go:39 @ 03/24/23 02:34:09.271 (0s) > Enter [It] will start an ephemeral container in an existing pod [Conformance] - test/e2e/common/node/ephemeral_containers.go:46 @ 03/24/23 02:34:09.271 STEP: creating a target pod - test/e2e/common/node/ephemeral_containers.go:47 @ 03/24/23 02:34:09.271 STEP: adding an ephemeral container - test/e2e/common/node/ephemeral_containers.go:62 @ 03/24/23 02:34:11.31 STEP: checking pod container endpoints - test/e2e/common/node/ephemeral_containers.go:76 @ 03/24/23 02:34:13.352 Mar 24 02:34:13.352: INFO: ExecWithOptions {Command:[/bin/echo marco] Namespace:ephemeral-containers-test-7168 PodName:ephemeral-containers-target-pod ContainerName:debugger Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false} Mar 24 02:34:13.352: INFO: ExecWithOptions: Clientset creation Mar 24 02:34:13.352: INFO: ExecWithOptions: execute(POST https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-7168/pods/ephemeral-containers-target-pod/exec?command=%2Fbin%2Fecho&command=marco&container=debugger&container=debugger&stderr=true&stdout=true) Mar 24 02:34:13.435: INFO: Exec stderr: "" Mar 24 02:34:13.439: INFO: Unexpected error: Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-7168(61380093-cbc9-4ab6-8e96-145b7f925ca0)" ephemeral container "debugger": <*url.Error | 0xc0010b86f0>: Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-7168/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 815; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-7168/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false", Err: <http2.StreamError>{ StreamID: 815, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Failed to get logs for pod "ephemeral-containers-target-pod_ephemeral-containers-test-7168(61380093-cbc9-4ab6-8e96-145b7f925ca0)" ephemeral container "debugger": Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-7168/pods/ephemeral-containers-target-pod/log?container=debugger&previous=false": stream error: stream ID 815; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/ephemeral_containers.go:81 @ 03/24/23 02:34:13.439 < Exit [It] will start an ephemeral container in an existing pod [Conformance] - test/e2e/common/node/ephemeral_containers.go:46 @ 03/24/23 02:34:13.439 (4.169s) > Enter [AfterEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:13.439 Mar 24 02:34:13.439: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:13.444 (4ms) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:13.444 < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:13.444 (0s) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:34:13.444 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:13.444 STEP: Collecting events from namespace "ephemeral-containers-test-7168". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:34:13.444 STEP: Found 6 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:34:13.448 Mar 24 02:34:13.448: INFO: At 2023-03-24 02:34:09 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:34:13.448: INFO: At 2023-03-24 02:34:09 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container test-container-1 Mar 24 02:34:13.448: INFO: At 2023-03-24 02:34:09 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container test-container-1 Mar 24 02:34:13.448: INFO: At 2023-03-24 02:34:11 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:34:13.448: INFO: At 2023-03-24 02:34:11 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container debugger Mar 24 02:34:13.448: INFO: At 2023-03-24 02:34:11 +0000 UTC - event for ephemeral-containers-target-pod: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container debugger Mar 24 02:34:13.450: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:34:13.450: INFO: ephemeral-containers-target-pod tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:09 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:10 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:10 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:09 +0000 UTC }] Mar 24 02:34:13.450: INFO: Mar 24 02:34:13.453: INFO: Unable to fetch ephemeral-containers-test-7168/ephemeral-containers-target-pod/test-container-1 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/ephemeral-containers-test-7168/pods/ephemeral-containers-target-pod/log?container=test-container-1&previous=false&tailLines=42": stream error: stream ID 823; INTERNAL_ERROR; received from peer Mar 24 02:34:13.455: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:13.458: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:34:13.459: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:13.460: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:13.466: INFO: ephemeral-containers-target-pod started at 2023-03-24 02:34:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 02:34:13.466: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df started at 2023-03-24 02:33:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df ready: true, restart count 0 Mar 24 02:34:13.466: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:13.466: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container client-container ready: true, restart count 0 Mar 24 02:34:13.466: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:13.466: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:13.466: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:34:13.466: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:34:13.466: INFO: Container createcm-volume-test ready: false, restart count 0 Mar 24 02:34:13.466: INFO: Container delcm-volume-test ready: false, restart count 0 Mar 24 02:34:13.466: INFO: Container updcm-volume-test ready: false, restart count 0 Mar 24 02:34:13.466: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:34:13.466: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:34:13.466: INFO: busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f ready: false, restart count 0 Mar 24 02:34:13.466: INFO: busybox-85dd7a8e-4f0e-4163-bb8b-419e26beadc2 started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:13.466: INFO: Container busybox ready: true, restart count 0 W0324 02:34:13.468703 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:34:13.855: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:13.855 (411ms) < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:34:13.855 (411ms) > Enter [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:34:13.855 STEP: Destroying namespace "ephemeral-containers-test-7168" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:34:13.855 < Exit [DeferCleanup (Each)] [sig-node] Ephemeral Containers [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:34:13.863 (9ms)
Find ephemeral-containers-target-pod_ephemeral-containers-test-7168(61380093-cbc9-4ab6-8e96-145b7f925ca0) mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swith\ssubdomain\sfield\shas\sFQDN\,\shostname\sis\sshortname$'
[FAILED] failed to get logs from hostfqdn-208890 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5304/pods/hostfqdn-208890/log?container=test-container&previous=false": stream error: stream ID 1123; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:24.471from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:36:20.415 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:20.416 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:20.416 Mar 24 02:36:20.421: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:36:20.421 (6ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:20.421 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:20.421 (0s) > Enter [It] a pod with subdomain field has FQDN, hostname is shortname - test/e2e_node/pod_hostnamefqdn_test.go:114 @ 03/24/23 02:36:20.421 STEP: Creating a pod to test shortname and fqdn - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:36:20.421 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:36:24.462 Mar 24 02:36:24.463: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod hostfqdn-208890 container test-container: <nil> Mar 24 02:36:24.465: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "hostfqdn-208890" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5304/pods/hostfqdn-208890/log?container=test-container&previous=false": stream error: stream ID 1123; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:36:24.465 Mar 24 02:36:24.471: INFO: Unexpected error: <*fmt.wrapError | 0xc000ab5220>: failed to get logs from hostfqdn-208890 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5304/pods/hostfqdn-208890/log?container=test-container&previous=false": stream error: stream ID 1123; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-208890 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5304/pods/hostfqdn-208890/log?container=test-container&previous=false\": stream error: stream ID 1123; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0012d1500>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5304/pods/hostfqdn-208890/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 1123, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-208890 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-5304/pods/hostfqdn-208890/log?container=test-container&previous=false": stream error: stream ID 1123; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:24.471 < Exit [It] a pod with subdomain field has FQDN, hostname is shortname - test/e2e_node/pod_hostnamefqdn_test.go:114 @ 03/24/23 02:36:24.471 (4.05s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:24.471 Mar 24 02:36:24.471: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:24.473 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:24.473 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:24.473 (1ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:36:24.473 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:24.473 STEP: Collecting events from namespace "hostfqdn-5304". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:24.473 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:24.48 Mar 24 02:36:24.480: INFO: At 2023-03-24 02:36:21 +0000 UTC - event for hostfqdn-208890: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:36:24.480: INFO: At 2023-03-24 02:36:21 +0000 UTC - event for hostfqdn-208890: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 02:36:24.480: INFO: At 2023-03-24 02:36:21 +0000 UTC - event for hostfqdn-208890: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 02:36:24.482: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:24.482: INFO: Mar 24 02:36:24.484: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:24.487: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:24.487: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:24.489: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:24.494: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:24.494: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:24.494: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:24.494: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:36:24.494: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:24.494: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:36:24.494: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:24.494: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:24.494: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:24.494: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:24.494: INFO: busybox-770178eb-3a40-4ab9-8b9f-3e9983310254 started at 2023-03-24 02:36:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:24.494: INFO: Container busybox ready: true, restart count 0 Mar 24 02:36:24.494: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:24.494: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:24.494: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:24.494: INFO: Container agnhost-container ready: true, restart count 2 W0324 02:36:24.495773 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:25.003: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:25.003 (530ms) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:36:25.003 (530ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:36:25.003 STEP: Destroying namespace "hostfqdn-5304" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:25.003 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:36:25.006 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swith\ssubdomain\sfield\shas\sFQDN\,\swhen\ssetHostnameAsFQDN\sis\sset\sto\strue\,\sthe\sFQDN\sis\sset\sas\shostname$'
[FAILED] failed to get logs from hostfqdn-93259 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9156/pods/hostfqdn-93259/log?container=test-container&previous=false": stream error: stream ID 1349; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:37:31.275from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:37:27.219 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:37:27.219 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 02:37:27.219 Mar 24 02:37:27.223: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:37:27.223 (3ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:27.223 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:27.223 (0s) > Enter [It] a pod with subdomain field has FQDN, when setHostnameAsFQDN is set to true, the FQDN is set as hostname - test/e2e_node/pod_hostnamefqdn_test.go:133 @ 03/24/23 02:37:27.223 STEP: Creating a pod to test fqdn and fqdn - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:37:27.223 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:37:31.265 Mar 24 02:37:31.267: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod hostfqdn-93259 container test-container: <nil> Mar 24 02:37:31.269: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "hostfqdn-93259" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9156/pods/hostfqdn-93259/log?container=test-container&previous=false": stream error: stream ID 1349; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:37:31.269 Mar 24 02:37:31.275: INFO: Unexpected error: <*fmt.wrapError | 0xc000fe16a0>: failed to get logs from hostfqdn-93259 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9156/pods/hostfqdn-93259/log?container=test-container&previous=false": stream error: stream ID 1349; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-93259 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9156/pods/hostfqdn-93259/log?container=test-container&previous=false\": stream error: stream ID 1349; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000d60ed0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9156/pods/hostfqdn-93259/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 1349, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-93259 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9156/pods/hostfqdn-93259/log?container=test-container&previous=false": stream error: stream ID 1349; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:37:31.275 < Exit [It] a pod with subdomain field has FQDN, when setHostnameAsFQDN is set to true, the FQDN is set as hostname - test/e2e_node/pod_hostnamefqdn_test.go:133 @ 03/24/23 02:37:31.275 (4.052s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:31.275 Mar 24 02:37:31.275: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:31.277 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:31.277 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:31.277 (0s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:37:31.277 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:31.277 STEP: Collecting events from namespace "hostfqdn-9156". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:37:31.277 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:37:31.278 Mar 24 02:37:31.278: INFO: At 2023-03-24 02:37:27 +0000 UTC - event for hostfqdn-93259: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:37:31.278: INFO: At 2023-03-24 02:37:27 +0000 UTC - event for hostfqdn-93259: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 02:37:31.278: INFO: At 2023-03-24 02:37:27 +0000 UTC - event for hostfqdn-93259: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 02:37:31.279: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:37:31.279: INFO: Mar 24 02:37:31.280: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:31.282: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:37:31.282: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:31.283: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:31.287: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:31.287: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:37:31.287: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:31.287: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:31.287: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:31.287: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:31.287: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:37:31.287: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:31.287: INFO: Container agnhost-container ready: false, restart count 4 Mar 24 02:37:31.287: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:31.287: INFO: Container client-container ready: true, restart count 0 Mar 24 02:37:31.287: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:31.287: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:37:31.287: INFO: netserver-0 started at 2023-03-24 02:37:23 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:31.287: INFO: Container webserver ready: false, restart count 0 Mar 24 02:37:31.287: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:37:31.287: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:37:31.287: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:37:31.287: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:37:31.287: INFO: pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205 started at 2023-03-24 02:37:21 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:31.287: INFO: Container main ready: true, restart count 0 Mar 24 02:37:31.287: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:31.287: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:31.287: INFO: Container container-handle-https-request ready: true, restart count 0 W0324 02:37:31.289119 1160 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:37:31.378: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:31.378 (101ms) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:37:31.378 (101ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:37:31.378 STEP: Destroying namespace "hostfqdn-9156" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:37:31.378 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:37:31.382 (4ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swithout\sFQDN\sis\snot\saffected\sby\sSetHostnameAsFQDN\sfield$'
[FAILED] failed to get logs from hostfqdn-37189 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1027/pods/hostfqdn-37189/log?container=test-container&previous=false": stream error: stream ID 503; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:31:50.646from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:31:46.593 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:31:46.593 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 02:31:46.594 Mar 24 02:31:46.602: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:31:46.602 (9ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:31:46.602 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:31:46.602 (0s) > Enter [It] a pod without FQDN is not affected by SetHostnameAsFQDN field - test/e2e_node/pod_hostnamefqdn_test.go:97 @ 03/24/23 02:31:46.602 STEP: Creating a pod to test shortname only - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:31:46.602 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:31:50.638 Mar 24 02:31:50.639: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod hostfqdn-37189 container test-container: <nil> Mar 24 02:31:50.641: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "hostfqdn-37189" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1027/pods/hostfqdn-37189/log?container=test-container&previous=false": stream error: stream ID 503; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:31:50.641 Mar 24 02:31:50.646: INFO: Unexpected error: <*fmt.wrapError | 0xc0003732c0>: failed to get logs from hostfqdn-37189 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1027/pods/hostfqdn-37189/log?container=test-container&previous=false": stream error: stream ID 503; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-37189 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1027/pods/hostfqdn-37189/log?container=test-container&previous=false\": stream error: stream ID 503; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0005ea6c0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1027/pods/hostfqdn-37189/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 503, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-37189 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-1027/pods/hostfqdn-37189/log?container=test-container&previous=false": stream error: stream ID 503; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:31:50.646 < Exit [It] a pod without FQDN is not affected by SetHostnameAsFQDN field - test/e2e_node/pod_hostnamefqdn_test.go:97 @ 03/24/23 02:31:50.646 (4.044s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:50.646 Mar 24 02:31:50.646: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:50.648 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:50.648 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:50.648 (0s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:31:50.648 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:50.648 STEP: Collecting events from namespace "hostfqdn-1027". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:31:50.648 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:31:50.649 Mar 24 02:31:50.649: INFO: At 2023-03-24 02:31:47 +0000 UTC - event for hostfqdn-37189: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:31:50.649: INFO: At 2023-03-24 02:31:47 +0000 UTC - event for hostfqdn-37189: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 02:31:50.649: INFO: At 2023-03-24 02:31:47 +0000 UTC - event for hostfqdn-37189: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 02:31:50.650: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:31:50.650: INFO: Mar 24 02:31:50.652: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:50.654: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:31:50.654: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:50.655: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:50.659: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:50.659: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:31:50.659: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:50.659: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:50.659: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:50.659: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:31:50.659: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:31:50.659: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:31:50.659: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:50.659: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:31:50.659: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:50.659: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:31:50.659: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:31:50.659: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:31:50.659: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:50.659: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:31:50.659: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:31:50.659: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:50.659: INFO: Container configmap-volume-binary-test ready: false, restart count 0 W0324 02:31:50.660165 1159 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:31:50.763: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:50.764 (116ms) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:31:50.764 (116ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:31:50.764 STEP: Destroying namespace "hostfqdn-1027" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:31:50.764 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:31:50.771 (8ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sHostname\sof\sPod\s\[NodeConformance\]\sa\spod\swithout\ssubdomain\sfield\sdoes\snot\shave\sFQDN$'
[FAILED] failed to get logs from hostfqdn-197718 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9018/pods/hostfqdn-197718/log?container=test-container&previous=false": stream error: stream ID 891; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:48.588from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:36:44.55 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:44.55 STEP: Building a namespace api object, basename hostfqdn - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:44.55 Mar 24 02:36:44.554: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:36:44.554 (3ms) > Enter [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:44.554 < Exit [BeforeEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:44.554 (0s) > Enter [It] a pod without subdomain field does not have FQDN - test/e2e_node/pod_hostnamefqdn_test.go:83 @ 03/24/23 02:36:44.554 STEP: Creating a pod to test shortname only - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:36:44.554 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:36:48.579 Mar 24 02:36:48.580: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod hostfqdn-197718 container test-container: <nil> Mar 24 02:36:48.583: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "hostfqdn-197718" container "test-container". Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9018/pods/hostfqdn-197718/log?container=test-container&previous=false": stream error: stream ID 891; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:36:48.583 Mar 24 02:36:48.588: INFO: Unexpected error: <*fmt.wrapError | 0xc001143060>: failed to get logs from hostfqdn-197718 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9018/pods/hostfqdn-197718/log?container=test-container&previous=false": stream error: stream ID 891; INTERNAL_ERROR; received from peer { msg: "failed to get logs from hostfqdn-197718 for test-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9018/pods/hostfqdn-197718/log?container=test-container&previous=false\": stream error: stream ID 891; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000d236b0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9018/pods/hostfqdn-197718/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 891, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from hostfqdn-197718 for test-container: Get "https://127.0.0.1:6443/api/v1/namespaces/hostfqdn-9018/pods/hostfqdn-197718/log?container=test-container&previous=false": stream error: stream ID 891; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:48.588 < Exit [It] a pod without subdomain field does not have FQDN - test/e2e_node/pod_hostnamefqdn_test.go:83 @ 03/24/23 02:36:48.588 (4.035s) > Enter [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:48.588 Mar 24 02:36:48.588: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:48.59 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:48.59 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:48.59 (0s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:36:48.59 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:48.59 STEP: Collecting events from namespace "hostfqdn-9018". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:48.59 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:48.591 Mar 24 02:36:48.591: INFO: At 2023-03-24 02:36:46 +0000 UTC - event for hostfqdn-197718: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:36:48.591: INFO: At 2023-03-24 02:36:46 +0000 UTC - event for hostfqdn-197718: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 02:36:48.591: INFO: At 2023-03-24 02:36:46 +0000 UTC - event for hostfqdn-197718: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 02:36:48.592: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:48.592: INFO: Mar 24 02:36:48.594: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:48.595: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:48.595: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:48.596: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:48.601: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:36:48.601: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:36:48.601: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:36:48.601: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.601: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:36:48.601: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.601: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:48.601: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.601: INFO: Container agnhost-container ready: true, restart count 3 Mar 24 02:36:48.601: INFO: pod-handle-http-request started at 2023-03-24 02:36:47 +0000 UTC (0+2 container statuses recorded) Mar 24 02:36:48.601: INFO: Container container-handle-http-request ready: false, restart count 0 Mar 24 02:36:48.601: INFO: Container container-handle-https-request ready: false, restart count 0 Mar 24 02:36:48.601: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:48.601: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:48.601: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:48.601: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:36:48.601: INFO: client-containers-a3dee898-dbed-4f9f-80f2-30f361904a64 started at 2023-03-24 02:36:43 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.601: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:36:48.601: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.601: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:48.601: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.601: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:48.601: INFO: busybox-770178eb-3a40-4ab9-8b9f-3e9983310254 started at 2023-03-24 02:36:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:48.601: INFO: Container busybox ready: true, restart count 0 W0324 02:36:48.602737 1163 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:50.062: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:50.062 (1.472s) < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:36:50.062 (1.472s) > Enter [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:36:50.062 STEP: Destroying namespace "hostfqdn-9018" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:50.062 < Exit [DeferCleanup (Each)] [sig-node] Hostname of Pod [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:36:50.078 (16ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\sa\sbusybox\scommand\sin\sa\spod\sshould\sprint\sthe\soutput\sto\slogs\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 60.000s. Expected <string>: to equal <string>: Hello World\n In [It] at: test/e2e/common/node/kubelet.go:79 @ 03/24/23 02:34:12.719from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 02:33:10.651 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:33:10.651 STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:33:10.651 Mar 24 02:33:10.658: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 02:33:10.658 (7ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:33:10.658 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:33:10.658 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 02:33:10.658 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 02:33:10.658 (0s) > Enter [It] should print the output to logs [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:52 @ 03/24/23 02:33:10.658 [FAILED] Timed out after 60.000s. Expected <string>: to equal <string>: Hello World\n In [It] at: test/e2e/common/node/kubelet.go:79 @ 03/24/23 02:34:12.719 < Exit [It] should print the output to logs [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:52 @ 03/24/23 02:34:12.719 (1m2.061s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:12.719 Mar 24 02:34:12.719: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:12.721 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:12.721 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:12.721 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 02:34:12.721 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:12.721 STEP: Collecting events from namespace "kubelet-test-809". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:34:12.721 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:34:12.722 Mar 24 02:34:12.722: INFO: At 2023-03-24 02:33:11 +0000 UTC - event for busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:34:12.722: INFO: At 2023-03-24 02:33:11 +0000 UTC - event for busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df Mar 24 02:34:12.722: INFO: At 2023-03-24 02:33:11 +0000 UTC - event for busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df Mar 24 02:34:12.724: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:34:12.724: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:33:10 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:33:12 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:33:12 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:33:10 +0000 UTC }] Mar 24 02:34:12.724: INFO: Mar 24 02:34:12.725: INFO: Unable to fetch kubelet-test-809/busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df/busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df logs: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-809/pods/busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df/log?container=busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df&previous=false&tailLines=42": stream error: stream ID 841; INTERNAL_ERROR; received from peer Mar 24 02:34:12.731: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:12.733: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:34:12.733: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:12.734: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:12.737: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:34:12.737: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:34:12.737: INFO: busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f ready: false, restart count 0 Mar 24 02:34:12.737: INFO: busybox-85dd7a8e-4f0e-4163-bb8b-419e26beadc2 started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container busybox ready: true, restart count 0 Mar 24 02:34:12.737: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:12.737: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:12.737: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:34:12.737: INFO: ephemeral-containers-target-pod started at 2023-03-24 02:34:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 02:34:12.737: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df started at 2023-03-24 02:33:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df ready: true, restart count 0 Mar 24 02:34:12.737: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:12.737: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:12.737: INFO: Container client-container ready: true, restart count 0 W0324 02:34:12.738790 1159 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:34:12.795: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:12.795 (74ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 02:34:12.795 (74ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 02:34:12.795 STEP: Destroying namespace "kubelet-test-809" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:34:12.795 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 02:34:12.797 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\sa\sread\sonly\sbusybox\scontainer\sshould\snot\swrite\sto\sroot\sfilesystem\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 60.001s. Expected <string>: to equal <string>: /bin/sh: can't create /file: Read-only file system\n In [It] at: test/e2e/common/node/kubelet.go:214 @ 03/24/23 02:35:04.383from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 02:34:02.351 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:34:02.351 STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:34:02.351 Mar 24 02:34:02.354: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 02:34:02.354 (4ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:02.354 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:02.354 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 02:34:02.354 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 02:34:02.354 (0s) > Enter [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:184 @ 03/24/23 02:34:02.354 [FAILED] Timed out after 60.001s. Expected <string>: to equal <string>: /bin/sh: can't create /file: Read-only file system\n In [It] at: test/e2e/common/node/kubelet.go:214 @ 03/24/23 02:35:04.383 < Exit [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:184 @ 03/24/23 02:35:04.383 (1m2.029s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:04.383 Mar 24 02:35:04.383: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:04.385 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:04.385 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:04.385 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 02:35:04.385 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:04.385 STEP: Collecting events from namespace "kubelet-test-7980". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:35:04.385 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:35:04.387 Mar 24 02:35:04.387: INFO: At 2023-03-24 02:34:03 +0000 UTC - event for busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:35:04.387: INFO: At 2023-03-24 02:34:03 +0000 UTC - event for busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da Mar 24 02:35:04.387: INFO: At 2023-03-24 02:34:03 +0000 UTC - event for busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da Mar 24 02:35:04.388: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:35:04.388: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:02 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:03 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:03 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:02 +0000 UTC }] Mar 24 02:35:04.388: INFO: Mar 24 02:35:04.390: INFO: Unable to fetch kubelet-test-7980/busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da/busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da logs: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-7980/pods/busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da/log?container=busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da&previous=false&tailLines=42": stream error: stream ID 1081; INTERNAL_ERROR; received from peer Mar 24 02:35:04.392: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:04.393: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:35:04.393: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:04.394: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:04.398: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:35:04.398: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:35:04.398: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:35:04.398: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:35:04.398: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:04.398: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:35:04.398: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:04.398: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:35:04.398: INFO: var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281 started at 2023-03-24 02:35:03 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:04.398: INFO: Container dapi-container ready: false, restart count 0 Mar 24 02:35:04.398: INFO: pod-secrets-6e661922-2398-4d4d-9904-b746eade53d2 started at 2023-03-24 02:35:04 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:04.398: INFO: Container secret-volume-test ready: false, restart count 0 Mar 24 02:35:04.398: INFO: static-pod-b4a4dc5a-1994-4a27-a3e3-a2c5eaafaf17-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:34:57 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:04.398: INFO: Container test ready: true, restart count 0 Mar 24 02:35:04.398: INFO: static-pod-f3de9564-0369-4a2e-a776-2930fbc4275a-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:35:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:04.398: INFO: Container test ready: true, restart count 0 Mar 24 02:35:04.398: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:04.398: INFO: Container client-container ready: false, restart count 0 W0324 02:35:04.399136 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:35:04.459: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:04.459 (73ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 02:35:04.46 (75ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 02:35:04.46 STEP: Destroying namespace "kubelet-test-7980" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:35:04.46 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 02:35:04.463 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\san\sagnhost\sPod\swith\shostAliases\sshould\swrite\sentries\sto\s\/etc\/hosts\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-493/pods/agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078/log": stream error: stream ID 531; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/kubelet.go:165 @ 03/24/23 02:30:59.56from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 02:30:57.505 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:30:57.505 STEP: Building a namespace api object, basename kubelet-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:30:57.505 Mar 24 02:30:57.511: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Kubelet - set up framework | framework.go:191 @ 03/24/23 02:30:57.511 (6ms) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:57.511 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:57.511 (0s) > Enter [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 02:30:57.511 < Exit [BeforeEach] [sig-node] Kubelet - test/e2e/common/node/kubelet.go:41 @ 03/24/23 02:30:57.511 (0s) > Enter [It] should write entries to /etc/hosts [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:148 @ 03/24/23 02:30:57.511 STEP: Waiting for pod completion - test/e2e/common/node/kubelet.go:160 @ 03/24/23 02:30:57.531 Mar 24 02:30:59.560: INFO: Unexpected error: <*url.Error | 0xc001190120>: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-493/pods/agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078/log": stream error: stream ID 531; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-493/pods/agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078/log", Err: <http2.StreamError>{ StreamID: 531, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-493/pods/agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078/log": stream error: stream ID 531; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/kubelet.go:165 @ 03/24/23 02:30:59.56 < Exit [It] should write entries to /etc/hosts [NodeConformance] [Conformance] - test/e2e/common/node/kubelet.go:148 @ 03/24/23 02:30:59.56 (2.049s) > Enter [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:30:59.56 Mar 24 02:30:59.560: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Kubelet - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:30:59.562 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:30:59.562 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:30:59.562 (0s) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 02:30:59.562 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:30:59.562 STEP: Collecting events from namespace "kubelet-test-493". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:30:59.562 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:30:59.564 Mar 24 02:30:59.564: INFO: At 2023-03-24 02:30:58 +0000 UTC - event for agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:30:59.564: INFO: At 2023-03-24 02:30:58 +0000 UTC - event for agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:30:59.564: INFO: At 2023-03-24 02:30:58 +0000 UTC - event for agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:30:59.565: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:30:59.565: INFO: agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:57 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:57 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:57 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:57 +0000 UTC }] Mar 24 02:30:59.565: INFO: Mar 24 02:30:59.567: INFO: Unable to fetch kubelet-test-493/agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/kubelet-test-493/pods/agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 539; INTERNAL_ERROR; received from peer Mar 24 02:30:59.568: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:59.570: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:30:59.570: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:59.571: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:59.575: INFO: busybox-readonly-true-22ccc66d-4922-4450-93a5-835840382f52 started at 2023-03-24 02:30:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:59.575: INFO: Container busybox-readonly-true-22ccc66d-4922-4450-93a5-835840382f52 ready: false, restart count 0 Mar 24 02:30:59.575: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:59.575: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:30:59.575: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:59.575: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:30:59.575: INFO: agnhost-host-aliases0c2da8fa-2edd-46cf-add9-84e3182f1078 started at 2023-03-24 02:30:57 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:59.575: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 02:30:59.575: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:59.575: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:30:59.575: INFO: server-envvars-72de4a5a-7330-46fc-9900-38520968b729 started at 2023-03-24 02:30:43 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:59.575: INFO: Container srv ready: true, restart count 0 Mar 24 02:30:59.575: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:30:59.575: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:30:59.575: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:30:59.575: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:30:59.575: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:30:59.575: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:30:59.575: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:30:59.575: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:30:59.575: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:59.575: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:30:59.575: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:30:59.575: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:30:59.575: INFO: Container configmap-volume-binary-test ready: false, restart count 0 W0324 02:30:59.576905 1172 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:30:59.642: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:30:59.642 (80ms) < Exit [DeferCleanup (Each)] [sig-node] Kubelet - dump namespaces | framework.go:209 @ 03/24/23 02:30:59.642 (80ms) > Enter [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 02:30:59.642 STEP: Destroying namespace "kubelet-test-493" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:30:59.642 < Exit [DeferCleanup (Each)] [sig-node] Kubelet - tear down framework | framework.go:206 @ 03/24/23 02:30:59.645 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sPods\sshould\scontain\senvironment\svariables\sfor\sservices\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Container should have service environment variables set Unexpected error: <*fmt.wrapError | 0xc000aa9d80>: failed to get logs from client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 493; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a for env3cont: Get \"https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false\": stream error: stream ID 493; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0015f7440>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false", Err: <http2.StreamError>{ StreamID: 493, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } occurred In [It] at: test/e2e/common/node/pods.go:526 @ 03/24/23 02:30:57.409from junit_cos-stable01.xml
goroutine 506 [running]: runtime/debug.Stack() /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/runtime/debug/stack.go:24 +0x65 runtime/debug.PrintStack() /go/src/k8s.io/kubernetes/_output/local/.gimme/versions/go1.20.2.linux.amd64/src/runtime/debug/stack.go:16 +0x19 k8s.io/kubernetes/test/e2e/common/node.expectNoErrorWithRetries(0xc0015bdea0, 0x3, {0xc0010df030, 0x1, 0x1}) test/e2e/common/node/pods.go:184 +0x189 k8s.io/kubernetes/test/e2e/common/node.glob..func15.6({0x7f257554e420, 0xc0010d9b90}) test/e2e/common/node/pods.go:526 +0xa85 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x5bb29c0?, 0xc0010d9b90}) vendor/github.com/onsi/ginkgo/v2/internal/node.go:456 +0x48 k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3() vendor/github.com/onsi/ginkgo/v2/internal/suite.go:863 +0x98 created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode vendor/github.com/onsi/ginkgo/v2/internal/suite.go:850 +0xd65 > Enter [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 02:30:43.278 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:30:43.279 STEP: Building a namespace api object, basename pods - test/e2e/framework/framework.go:250 @ 03/24/23 02:30:43.279 Mar 24 02:30:43.282: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 02:30:43.282 (4ms) > Enter [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:43.282 < Exit [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:43.282 (0s) > Enter [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 02:30:43.282 < Exit [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 02:30:43.282 (0s) > Enter [It] should contain environment variables for services [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:445 @ 03/24/23 02:30:43.282 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:30:49.327 Mar 24 02:30:49.329: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a container env3cont: <nil> Mar 24 02:30:49.331: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a" container "env3cont". Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 461; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:30:49.331 Mar 24 02:30:49.336: INFO: (Attempt 1 of 3) Unexpected error occurred: failed to get logs from client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 461; INTERNAL_ERROR; received from peer STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:30:53.363 Mar 24 02:30:53.365: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a container env3cont: <nil> Mar 24 02:30:53.367: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a" container "env3cont". Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 477; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:30:53.367 Mar 24 02:30:53.373: INFO: (Attempt 2 of 3) Unexpected error occurred: failed to get logs from client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 477; INTERNAL_ERROR; received from peer STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:30:57.399 Mar 24 02:30:57.401: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a container env3cont: <nil> Mar 24 02:30:57.402: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a" container "env3cont". Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 493; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:30:57.402 Mar 24 02:30:57.408: INFO: (Attempt 3 of 3) Unexpected error occurred: failed to get logs from client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 493; INTERNAL_ERROR; received from peer [FAILED] Container should have service environment variables set Unexpected error: <*fmt.wrapError | 0xc000aa9d80>: failed to get logs from client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a for env3cont: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false": stream error: stream ID 493; INTERNAL_ERROR; received from peer { msg: "failed to get logs from client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a for env3cont: Get \"https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false\": stream error: stream ID 493; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0015f7440>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a/log?container=env3cont&previous=false", Err: <http2.StreamError>{ StreamID: 493, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } occurred In [It] at: test/e2e/common/node/pods.go:526 @ 03/24/23 02:30:57.409 < Exit [It] should contain environment variables for services [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:445 @ 03/24/23 02:30:57.409 (14.127s) > Enter [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:30:57.409 Mar 24 02:30:57.409: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:30:57.41 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:30:57.411 < Exit [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:30:57.411 (0s) > Enter [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 02:30:57.411 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:30:57.411 STEP: Collecting events from namespace "pods-9025". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:30:57.411 STEP: Found 12 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:30:57.413 Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:43 +0000 UTC - event for server-envvars-72de4a5a-7330-46fc-9900-38520968b729: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:43 +0000 UTC - event for server-envvars-72de4a5a-7330-46fc-9900-38520968b729: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container srv Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:44 +0000 UTC - event for server-envvars-72de4a5a-7330-46fc-9900-38520968b729: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container srv Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:45 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:45 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container env3cont Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:46 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container env3cont Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:49 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:49 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container env3cont Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:50 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container env3cont Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:53 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:53 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container env3cont Mar 24 02:30:57.413: INFO: At 2023-03-24 02:30:54 +0000 UTC - event for client-envvars-e249230e-0eca-4b9b-9a32-639f8cd40c2a: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container env3cont Mar 24 02:30:57.414: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:30:57.414: INFO: server-envvars-72de4a5a-7330-46fc-9900-38520968b729 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:43 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:45 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:45 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:43 +0000 UTC }] Mar 24 02:30:57.414: INFO: Mar 24 02:30:57.416: INFO: Unable to fetch pods-9025/server-envvars-72de4a5a-7330-46fc-9900-38520968b729/srv logs: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-9025/pods/server-envvars-72de4a5a-7330-46fc-9900-38520968b729/log?container=srv&previous=false&tailLines=42": stream error: stream ID 505; INTERNAL_ERROR; received from peer Mar 24 02:30:57.417: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:57.419: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:30:57.419: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:57.420: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:57.425: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:30:57.425: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:30:57.425: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:30:57.425: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:30:57.425: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:57.425: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:30:57.425: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:30:57.425: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:30:57.425: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:30:57.425: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:30:57.425: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:30:57.425: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:30:57.425: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:30:57.425: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:57.425: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:30:57.425: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:57.425: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:30:57.425: INFO: server-envvars-72de4a5a-7330-46fc-9900-38520968b729 started at 2023-03-24 02:30:43 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:57.425: INFO: Container srv ready: true, restart count 0 Mar 24 02:30:57.425: INFO: busybox-readonly-true-22ccc66d-4922-4450-93a5-835840382f52 started at 2023-03-24 02:30:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:57.425: INFO: Container busybox-readonly-true-22ccc66d-4922-4450-93a5-835840382f52 ready: false, restart count 0 Mar 24 02:30:57.425: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:57.425: INFO: Container agnhost ready: true, restart count 0 W0324 02:30:57.426203 1172 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:30:57.491: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:30:57.491 (80ms) < Exit [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 02:30:57.491 (80ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 02:30:57.491 STEP: Destroying namespace "pods-9025" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:30:57.491 < Exit [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 02:30:57.494 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sPods\sshould\ssupport\sretrieving\slogs\sfrom\sthe\scontainer\sover\swebsockets\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Failed to open websocket to wss://127.0.0.1:6443/api/v1/namespaces/pods-8148/pods/pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205/log?container=main: websocket.Dial wss://127.0.0.1:6443/api/v1/namespaces/pods-8148/pods/pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205/log?container=main: unexpected EOF In [It] at: test/e2e/common/node/pods.go:654 @ 03/24/23 02:37:23.549from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 02:37:21.48 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:37:21.48 STEP: Building a namespace api object, basename pods - test/e2e/framework/framework.go:250 @ 03/24/23 02:37:21.48 Mar 24 02:37:21.484: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Pods - set up framework | framework.go:191 @ 03/24/23 02:37:21.484 (4ms) > Enter [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:21.484 < Exit [BeforeEach] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:21.484 (0s) > Enter [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 02:37:21.484 < Exit [BeforeEach] [sig-node] Pods - test/e2e/common/node/pods.go:195 @ 03/24/23 02:37:21.484 (0s) > Enter [It] should support retrieving logs from the container over websockets [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:619 @ 03/24/23 02:37:21.484 STEP: creating the pod - test/e2e/common/node/pods.go:623 @ 03/24/23 02:37:21.484 STEP: submitting the pod to kubernetes - test/e2e/common/node/pods.go:640 @ 03/24/23 02:37:21.484 [FAILED] Failed to open websocket to wss://127.0.0.1:6443/api/v1/namespaces/pods-8148/pods/pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205/log?container=main: websocket.Dial wss://127.0.0.1:6443/api/v1/namespaces/pods-8148/pods/pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205/log?container=main: unexpected EOF In [It] at: test/e2e/common/node/pods.go:654 @ 03/24/23 02:37:23.549 < Exit [It] should support retrieving logs from the container over websockets [NodeConformance] [Conformance] - test/e2e/common/node/pods.go:619 @ 03/24/23 02:37:23.549 (2.065s) > Enter [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:23.549 Mar 24 02:37:23.549: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Pods - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:37:23.556 (8ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:23.556 < Exit [DeferCleanup (Each)] [sig-node] Pods - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:37:23.556 (0s) > Enter [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 02:37:23.556 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:23.557 STEP: Collecting events from namespace "pods-8148". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:37:23.557 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:37:23.559 Mar 24 02:37:23.559: INFO: At 2023-03-24 02:37:22 +0000 UTC - event for pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:37:23.559: INFO: At 2023-03-24 02:37:22 +0000 UTC - event for pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container main Mar 24 02:37:23.559: INFO: At 2023-03-24 02:37:22 +0000 UTC - event for pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container main Mar 24 02:37:23.561: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:37:23.561: INFO: pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:21 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:23 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:23 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:21 +0000 UTC }] Mar 24 02:37:23.561: INFO: Mar 24 02:37:23.566: INFO: Unable to fetch pods-8148/pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205/main logs: Get "https://127.0.0.1:6443/api/v1/namespaces/pods-8148/pods/pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205/log?container=main&previous=false&tailLines=42": stream error: stream ID 1297; INTERNAL_ERROR; received from peer Mar 24 02:37:23.570: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:23.581: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:37:23.581: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:23.587: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:37:23.607: INFO: pod-handle-http-request started at 2023-03-24 02:36:47 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:23.607: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:23.607: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:23.607: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:37:23.607: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:37:23.607: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:37:23.607: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:37:23.607: INFO: pod-logs-websocket-66aa1ee9-7fe2-4146-80fa-275890f9e205 started at 2023-03-24 02:37:21 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.607: INFO: Container main ready: true, restart count 0 Mar 24 02:37:23.607: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:23.607: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:23.607: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:23.607: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.607: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:37:23.607: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:37:23.607: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:37:23.607: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:37:23.607: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.607: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:37:23.607: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.607: INFO: Container agnhost-container ready: false, restart count 4 Mar 24 02:37:23.607: INFO: annotationupdatee510e244-11cb-43ae-856e-5297608176d1 started at 2023-03-24 02:37:08 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.607: INFO: Container client-container ready: true, restart count 0 Mar 24 02:37:23.607: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.607: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:37:23.607: INFO: netserver-0 started at 2023-03-24 02:37:23 +0000 UTC (0+1 container statuses recorded) Mar 24 02:37:23.607: INFO: Container webserver ready: false, restart count 0 W0324 02:37:23.612641 1160 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:37:24.102: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:37:24.102 (545ms) < Exit [DeferCleanup (Each)] [sig-node] Pods - dump namespaces | framework.go:209 @ 03/24/23 02:37:24.102 (545ms) > Enter [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 02:37:24.102 STEP: Destroying namespace "pods-8148" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:37:24.102 < Exit [DeferCleanup (Each)] [sig-node] Pods - tear down framework | framework.go:206 @ 03/24/23 02:37:24.131 (29ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecrets\sshould\sbe\sconsumable\sfrom\spods\sin\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89 for secret-env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-6128/pods/pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89/log?container=secret-env-test&previous=false": stream error: stream ID 951; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:56.314from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 02:36:52.219 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:52.219 STEP: Building a namespace api object, basename secrets - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:52.219 Mar 24 02:36:52.253: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 02:36:52.253 (34ms) > Enter [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:52.253 < Exit [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:52.253 (0s) > Enter [It] should be consumable from pods in env vars [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:46 @ 03/24/23 02:36:52.253 STEP: Creating secret with name secret-test-3ef800c3-7527-48b7-bb35-3c9fd8b43eaf - test/e2e/common/node/secrets.go:50 @ 03/24/23 02:36:52.253 STEP: Creating a pod to test consume secrets - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:36:52.258 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:36:56.303 Mar 24 02:36:56.305: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89 container secret-env-test: <nil> Mar 24 02:36:56.307: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89" container "secret-env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-6128/pods/pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89/log?container=secret-env-test&previous=false": stream error: stream ID 951; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:36:56.307 Mar 24 02:36:56.314: INFO: Unexpected error: <*fmt.wrapError | 0xc0017bdd00>: failed to get logs from pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89 for secret-env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-6128/pods/pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89/log?container=secret-env-test&previous=false": stream error: stream ID 951; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89 for secret-env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/secrets-6128/pods/pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89/log?container=secret-env-test&previous=false\": stream error: stream ID 951; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000a6c840>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/secrets-6128/pods/pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89/log?container=secret-env-test&previous=false", Err: <http2.StreamError>{ StreamID: 951, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89 for secret-env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-6128/pods/pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89/log?container=secret-env-test&previous=false": stream error: stream ID 951; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:56.314 < Exit [It] should be consumable from pods in env vars [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:46 @ 03/24/23 02:36:56.314 (4.061s) > Enter [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:56.314 Mar 24 02:36:56.314: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:56.316 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:56.316 < Exit [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:56.316 (0s) > Enter [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 02:36:56.316 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:56.316 STEP: Collecting events from namespace "secrets-6128". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:56.316 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:56.317 Mar 24 02:36:56.317: INFO: At 2023-03-24 02:36:53 +0000 UTC - event for pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:36:56.317: INFO: At 2023-03-24 02:36:53 +0000 UTC - event for pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container secret-env-test Mar 24 02:36:56.317: INFO: At 2023-03-24 02:36:53 +0000 UTC - event for pod-secrets-81806b7b-0a03-43ab-bd89-a1b2d3211d89: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container secret-env-test Mar 24 02:36:56.318: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:56.318: INFO: Mar 24 02:36:56.319: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:56.321: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:56.321: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:56.322: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:56.327: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:56.327: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:56.327: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:56.327: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:56.327: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:56.327: INFO: Container agnhost-container ready: true, restart count 4 Mar 24 02:36:56.327: INFO: pod-with-poststart-http-hook started at 2023-03-24 02:36:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:56.327: INFO: Container pod-with-poststart-http-hook ready: true, restart count 0 Mar 24 02:36:56.327: INFO: pod-handle-http-request started at 2023-03-24 02:36:40 +0000 UTC (0+2 container statuses recorded) Mar 24 02:36:56.327: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:36:56.327: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:36:56.327: INFO: pod-with-poststart-exec-hook started at 2023-03-24 02:36:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:56.327: INFO: Container pod-with-poststart-exec-hook ready: true, restart count 0 Mar 24 02:36:56.327: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:56.327: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:56.327: INFO: pod-handle-http-request started at 2023-03-24 02:36:50 +0000 UTC (0+2 container statuses recorded) Mar 24 02:36:56.327: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:36:56.327: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:36:56.327: INFO: busybox-770178eb-3a40-4ab9-8b9f-3e9983310254 started at 2023-03-24 02:36:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:56.327: INFO: Container busybox ready: true, restart count 0 Mar 24 02:36:56.327: INFO: pod-handle-http-request started at 2023-03-24 02:36:47 +0000 UTC (0+2 container statuses recorded) Mar 24 02:36:56.327: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:36:56.327: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:36:56.327: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:56.327: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:56.327: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:56.327: INFO: Container updcm-volume-test ready: true, restart count 0 W0324 02:36:56.328289 1163 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:59.554: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:59.554 (3.239s) < Exit [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 02:36:59.554 (3.239s) > Enter [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 02:36:59.554 STEP: Destroying namespace "secrets-6128" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:59.555 < Exit [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 02:36:59.563 (9ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecrets\sshould\sbe\sconsumable\svia\sthe\senvironment\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-97/pods/pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8/log?container=env-test&previous=false": stream error: stream ID 691; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:31:39.249from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 02:31:35.203 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:31:35.203 STEP: Building a namespace api object, basename secrets - test/e2e/framework/framework.go:250 @ 03/24/23 02:31:35.203 Mar 24 02:31:35.206: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Secrets - set up framework | framework.go:191 @ 03/24/23 02:31:35.206 (4ms) > Enter [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:31:35.206 < Exit [BeforeEach] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:31:35.206 (0s) > Enter [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:95 @ 03/24/23 02:31:35.206 STEP: creating secret secrets-97/secret-test-25dd53f0-28c5-4375-8ad6-b4faf75cf37d - test/e2e/common/node/secrets.go:98 @ 03/24/23 02:31:35.206 STEP: Creating a pod to test consume secrets - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:31:35.208 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:31:39.239 Mar 24 02:31:39.241: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8 container env-test: <nil> Mar 24 02:31:39.243: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8" container "env-test". Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-97/pods/pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8/log?container=env-test&previous=false": stream error: stream ID 691; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:31:39.243 Mar 24 02:31:39.248: INFO: Unexpected error: <*fmt.wrapError | 0xc000415ce0>: failed to get logs from pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-97/pods/pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8/log?container=env-test&previous=false": stream error: stream ID 691; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8 for env-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/secrets-97/pods/pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8/log?container=env-test&previous=false\": stream error: stream ID 691; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000c65b60>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/secrets-97/pods/pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8/log?container=env-test&previous=false", Err: <http2.StreamError>{ StreamID: 691, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8 for env-test: Get "https://127.0.0.1:6443/api/v1/namespaces/secrets-97/pods/pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8/log?container=env-test&previous=false": stream error: stream ID 691; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:31:39.249 < Exit [It] should be consumable via the environment [NodeConformance] [Conformance] - test/e2e/common/node/secrets.go:95 @ 03/24/23 02:31:39.249 (4.042s) > Enter [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:39.249 Mar 24 02:31:39.249: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Secrets - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:39.25 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:39.25 < Exit [DeferCleanup (Each)] [sig-node] Secrets - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:39.25 (0s) > Enter [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 02:31:39.25 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:39.25 STEP: Collecting events from namespace "secrets-97". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:31:39.25 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:31:39.252 Mar 24 02:31:39.252: INFO: At 2023-03-24 02:31:35 +0000 UTC - event for pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:31:39.252: INFO: At 2023-03-24 02:31:35 +0000 UTC - event for pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container env-test Mar 24 02:31:39.252: INFO: At 2023-03-24 02:31:35 +0000 UTC - event for pod-configmaps-b940c139-2331-412a-a798-77ffca6aeef8: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container env-test Mar 24 02:31:39.253: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:31:39.253: INFO: Mar 24 02:31:39.254: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:39.256: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:31:39.256: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:39.257: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:39.261: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:39.261: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:31:39.261: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:31:39.261: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:31:39.261: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:39.261: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:31:39.261: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:31:39.261: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:31:39.261: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:39.261: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:31:39.261: INFO: pod0b6334d5-f2d8-41af-aa4c-7a46ddfc22ef started at 2023-03-24 02:31:27 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:39.261: INFO: Container container1df5cf25-de79-4061-a718-a01809c269ab ready: false, restart count 0 Mar 24 02:31:39.261: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:31:39.261: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:39.261: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:31:39.261: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:39.261: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:31:39.261: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:39.261: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:39.261: INFO: pod7d70bd6f-d01d-44e6-82d1-642d1e1306c6 started at 2023-03-24 02:31:31 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:39.261: INFO: Container container3f8c87a2-eeec-4802-a18e-63a3b82f41bb ready: false, restart count 0 Mar 24 02:31:39.261: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:39.261: INFO: Container test-webserver ready: true, restart count 0 W0324 02:31:39.262584 1172 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:31:39.320: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:39.32 (70ms) < Exit [DeferCleanup (Each)] [sig-node] Secrets - dump namespaces | framework.go:209 @ 03/24/23 02:31:39.32 (70ms) > Enter [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 02:31:39.32 STEP: Destroying namespace "secrets-97" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:31:39.32 < Exit [DeferCleanup (Each)] [sig-node] Secrets - tear down framework | framework.go:206 @ 03/24/23 02:31:39.323 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\sWhen\screating\sa\spod\swith\sprivileged\sshould\srun\sthe\scontainer\sas\sunprivileged\swhen\sfalse\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] GetPodLogs for pod "busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f" failed: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-2442/pods/busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f/log?container=busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f&previous=false": stream error: stream ID 773; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/security_context.go:532 @ 03/24/23 02:34:09.156from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:34:05.114 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:34:05.114 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:34:05.114 Mar 24 02:34:05.122: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:34:05.122 (8ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:05.123 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:05.123 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:34:05.123 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:34:05.123 (0s) > Enter [It] should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:528 @ 03/24/23 02:34:05.123 [FAILED] GetPodLogs for pod "busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f" failed: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-2442/pods/busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f/log?container=busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f&previous=false": stream error: stream ID 773; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/security_context.go:532 @ 03/24/23 02:34:09.156 < Exit [It] should run the container as unprivileged when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:528 @ 03/24/23 02:34:09.156 (4.034s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:09.156 Mar 24 02:34:09.156: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:09.158 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:09.158 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:09.158 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:34:09.158 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:09.158 STEP: Collecting events from namespace "security-context-test-2442". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:34:09.158 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:34:09.16 Mar 24 02:34:09.160: INFO: At 2023-03-24 02:34:06 +0000 UTC - event for busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:34:09.160: INFO: At 2023-03-24 02:34:06 +0000 UTC - event for busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f Mar 24 02:34:09.160: INFO: At 2023-03-24 02:34:06 +0000 UTC - event for busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f Mar 24 02:34:09.161: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:34:09.161: INFO: busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:05 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:05 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:05 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:05 +0000 UTC }] Mar 24 02:34:09.161: INFO: Mar 24 02:34:09.163: INFO: Unable to fetch security-context-test-2442/busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f/busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-2442/pods/busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f/log?container=busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f&previous=false&tailLines=42": stream error: stream ID 781; INTERNAL_ERROR; received from peer Mar 24 02:34:09.164: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:09.166: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:34:09.166: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:09.167: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:09.171: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:09.171: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container client-container ready: true, restart count 0 Mar 24 02:34:09.171: INFO: pod-handle-http-request started at 2023-03-24 02:32:00 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:09.171: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:34:09.171: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:34:09.171: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df started at 2023-03-24 02:33:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df ready: true, restart count 0 Mar 24 02:34:09.171: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:34:09.171: INFO: busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f ready: false, restart count 0 Mar 24 02:34:09.171: INFO: busybox-85dd7a8e-4f0e-4163-bb8b-419e26beadc2 started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container busybox ready: true, restart count 0 Mar 24 02:34:09.171: INFO: pod-with-poststart-https-hook started at 2023-03-24 02:32:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container pod-with-poststart-https-hook ready: true, restart count 0 Mar 24 02:34:09.171: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:09.171: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:09.171: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:34:09.171: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:09.171: INFO: Container image-pull-test ready: true, restart count 0 W0324 02:34:09.173052 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:34:09.258: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:09.258 (99ms) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:34:09.258 (99ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:34:09.258 STEP: Destroying namespace "security-context-test-2442" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:34:09.258 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:34:09.26 (3ms)
Find busybox-privileged-false-278971b3-2295-40eb-a80b-1390f14c406f mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\swhen\screating\scontainers\swith\sAllowPrivilegeEscalation\sshould\sallow\sprivilege\sescalation\swhen\snot\sexplicitly\sset\sand\suid\s\!\=\s0\s\[LinuxOnly\]\s\[NodeConformance\]$'
[FAILED] Match output for pod "alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9" failed: failed to get output for container "alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9" of pod "alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9" In [It] at: test/e2e/common/node/security_context.go:597 @ 03/24/23 02:36:00.102from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:35:56.065 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:35:56.065 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:35:56.065 Mar 24 02:35:56.073: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:35:56.073 (8ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:56.073 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:56.073 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:35:56.073 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:35:56.073 (0s) > Enter [It] should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:594 @ 03/24/23 02:35:56.073 [FAILED] Match output for pod "alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9" failed: failed to get output for container "alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9" of pod "alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9" In [It] at: test/e2e/common/node/security_context.go:597 @ 03/24/23 02:36:00.102 < Exit [It] should allow privilege escalation when not explicitly set and uid != 0 [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:594 @ 03/24/23 02:36:00.102 (4.029s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:00.102 Mar 24 02:36:00.102: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:00.104 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:00.104 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:00.104 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:36:00.104 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:00.104 STEP: Collecting events from namespace "security-context-test-5904". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:00.104 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:00.105 Mar 24 02:36:00.105: INFO: At 2023-03-24 02:35:56 +0000 UTC - event for alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/nonewprivs:1.3" already present on machine Mar 24 02:36:00.105: INFO: At 2023-03-24 02:35:56 +0000 UTC - event for alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 Mar 24 02:36:00.105: INFO: At 2023-03-24 02:35:56 +0000 UTC - event for alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 Mar 24 02:36:00.107: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:00.107: INFO: alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:56 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:56 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:56 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:56 +0000 UTC }] Mar 24 02:36:00.107: INFO: Mar 24 02:36:00.109: INFO: Unable to fetch security-context-test-5904/alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9/alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-5904/pods/alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9/log?container=alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9&previous=false&tailLines=42": stream error: stream ID 1487; INTERNAL_ERROR; received from peer Mar 24 02:36:00.110: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:00.112: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:00.112: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:00.113: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:00.117: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:00.117: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container agnhost-container ready: true, restart count 1 Mar 24 02:36:00.117: INFO: alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 started at 2023-03-24 02:35:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 ready: false, restart count 0 Mar 24 02:36:00.117: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:00.117: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:00.117: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:00.117: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:36:00.117: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:36:00.117: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:00.117: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:00.117: INFO: busybox-2ac35595-9ff3-4ea2-b8d3-ac4a8a906b18 started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container busybox ready: false, restart count 0 Mar 24 02:36:00.117: INFO: container-must-be-restarted started at 2023-03-24 02:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:00.117: INFO: Container regular-1 ready: false, restart count 2 W0324 02:36:00.119109 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:00.202: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:00.202 (98ms) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:36:00.202 (98ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:36:00.202 STEP: Destroying namespace "security-context-test-5904" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:00.202 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:36:00.205 (3ms)
Find alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\swhen\screating\scontainers\swith\sAllowPrivilegeEscalation\sshould\sallow\sprivilege\sescalation\swhen\strue\s\[LinuxOnly\]\s\[NodeConformance\]$'
[FAILED] Match output for pod "alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0" failed: failed to get output for container "alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0" of pod "alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0" In [It] at: test/e2e/common/node/security_context.go:630 @ 03/24/23 02:34:17.908from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:34:13.867 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:34:13.868 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:34:13.868 Mar 24 02:34:13.876: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:34:13.876 (8ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:13.876 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:34:13.876 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:34:13.876 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:34:13.876 (0s) > Enter [It] should allow privilege escalation when true [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:626 @ 03/24/23 02:34:13.876 [FAILED] Match output for pod "alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0" failed: failed to get output for container "alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0" of pod "alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0" In [It] at: test/e2e/common/node/security_context.go:630 @ 03/24/23 02:34:17.908 < Exit [It] should allow privilege escalation when true [LinuxOnly] [NodeConformance] - test/e2e/common/node/security_context.go:626 @ 03/24/23 02:34:17.908 (4.032s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:17.908 Mar 24 02:34:17.908: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:17.91 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:17.91 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:17.91 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:34:17.91 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:17.91 STEP: Collecting events from namespace "security-context-test-6313". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:34:17.91 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:34:17.911 Mar 24 02:34:17.911: INFO: At 2023-03-24 02:34:14 +0000 UTC - event for alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/nonewprivs:1.3" already present on machine Mar 24 02:34:17.911: INFO: At 2023-03-24 02:34:14 +0000 UTC - event for alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0 Mar 24 02:34:17.911: INFO: At 2023-03-24 02:34:14 +0000 UTC - event for alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0 Mar 24 02:34:17.912: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:34:17.912: INFO: alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:13 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:13 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:13 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:34:13 +0000 UTC }] Mar 24 02:34:17.912: INFO: Mar 24 02:34:17.914: INFO: Unable to fetch security-context-test-6313/alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0/alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-6313/pods/alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0/log?container=alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0&previous=false&tailLines=42": stream error: stream ID 859; INTERNAL_ERROR; received from peer Mar 24 02:34:17.916: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:17.917: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:34:17.917: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:17.918: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:17.923: INFO: ephemeral-containers-target-pod started at 2023-03-24 02:34:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 02:34:17.923: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df started at 2023-03-24 02:33:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df ready: true, restart count 0 Mar 24 02:34:17.923: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:17.923: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container client-container ready: false, restart count 0 Mar 24 02:34:17.923: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:34:17.923: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:34:17.923: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:34:17.923: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:34:17.923: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:34:17.923: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:34:17.923: INFO: busybox-85dd7a8e-4f0e-4163-bb8b-419e26beadc2 started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container busybox ready: true, restart count 0 Mar 24 02:34:17.923: INFO: alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0 started at 2023-03-24 02:34:13 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:17.923: INFO: Container alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0 ready: false, restart count 0 Mar 24 02:34:17.923: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:17.923: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:17.923: INFO: Container configmap-volume-binary-test ready: false, restart count 0 W0324 02:34:17.924189 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:34:17.986: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:17.986 (76ms) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:34:17.986 (76ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:34:17.986 STEP: Destroying namespace "security-context-test-6313" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:34:17.986 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:34:17.988 (3ms)
Find alpine-nnp-true-786c57ee-c20c-4cce-819b-986c6cbf56a0 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\swhen\screating\scontainers\swith\sAllowPrivilegeEscalation\sshould\snot\sallow\sprivilege\sescalation\swhen\sfalse\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Match output for pod "alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241" failed: failed to get output for container "alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241" of pod "alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241" In [It] at: test/e2e/common/node/security_context.go:613 @ 03/24/23 02:26:46.381from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:26:42.209 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:26:42.209 STEP: Building a namespace api object, basename security-context-test - test/e2e/framework/framework.go:250 @ 03/24/23 02:26:42.209 Mar 24 02:26:42.229: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Security Context - set up framework | framework.go:191 @ 03/24/23 02:26:42.229 (20ms) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:42.229 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:42.229 (0s) > Enter [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:26:42.229 < Exit [BeforeEach] [sig-node] Security Context - test/e2e/common/node/security_context.go:50 @ 03/24/23 02:26:42.229 (0s) > Enter [It] should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:609 @ 03/24/23 02:26:42.229 [FAILED] Match output for pod "alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241" failed: failed to get output for container "alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241" of pod "alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241" In [It] at: test/e2e/common/node/security_context.go:613 @ 03/24/23 02:26:46.381 < Exit [It] should not allow privilege escalation when false [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/node/security_context.go:609 @ 03/24/23 02:26:46.381 (4.152s) > Enter [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:46.381 Mar 24 02:26:46.381: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Security Context - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:46.387 (6ms) > Enter [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:46.387 < Exit [DeferCleanup (Each)] [sig-node] Security Context - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:46.387 (0s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:26:46.387 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:46.387 STEP: Collecting events from namespace "security-context-test-3682". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:26:46.387 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:26:46.389 Mar 24 02:26:46.389: INFO: At 2023-03-24 02:26:43 +0000 UTC - event for alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/nonewprivs:1.3" already present on machine Mar 24 02:26:46.389: INFO: At 2023-03-24 02:26:43 +0000 UTC - event for alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 Mar 24 02:26:46.389: INFO: At 2023-03-24 02:26:43 +0000 UTC - event for alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 Mar 24 02:26:46.398: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:26:46.398: INFO: alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:26:42 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:26:42 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:26:42 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:26:42 +0000 UTC }] Mar 24 02:26:46.398: INFO: Mar 24 02:26:46.405: INFO: Unable to fetch security-context-test-3682/alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241/alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 logs: Get "https://127.0.0.1:6443/api/v1/namespaces/security-context-test-3682/pods/alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241/log?container=alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241&previous=false&tailLines=42": stream error: stream ID 63; INTERNAL_ERROR; received from peer Mar 24 02:26:46.407: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:46.429: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 86 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:29 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:26:46.429: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:46.432: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:46.480: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 02:26:46.480: INFO: pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362 started at 2023-03-24 02:26:46 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Container configmap-volume-test ready: false, restart count 0 Mar 24 02:26:46.480: INFO: pod58adf7cd-4828-42b8-a5ed-9cea0cc6f487 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Container containerad81c6b1-3fd8-40bc-94d9-7e998c87e7e0 ready: false, restart count 0 Mar 24 02:26:46.480: INFO: downward-api-a29c9413-1c00-4124-b6f3-3bb6f2fe8e3a started at 2023-03-24 02:26:44 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Container dapi-container ready: false, restart count 0 Mar 24 02:26:46.480: INFO: isolated-pid-ns-test-pod started at 2023-03-24 02:26:45 +0000 UTC (0+2 container statuses recorded) Mar 24 02:26:46.480: INFO: Container test-container-1 ready: false, restart count 0 Mar 24 02:26:46.480: INFO: Container test-container-2 ready: false, restart count 0 Mar 24 02:26:46.480: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Container back-off ready: false, restart count 0 Mar 24 02:26:46.480: INFO: pod-init-ada877c6-8b63-4d79-ade0-56ee2c9018dc started at 2023-03-24 02:26:45 +0000 UTC (2+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Init container init1 ready: false, restart count 0 Mar 24 02:26:46.480: INFO: Init container init2 ready: false, restart count 0 Mar 24 02:26:46.480: INFO: Container run1 ready: false, restart count 0 Mar 24 02:26:46.480: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Container client-container ready: true, restart count 0 Mar 24 02:26:46.480: INFO: alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 started at 2023-03-24 02:26:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:46.480: INFO: Container alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 ready: false, restart count 0 W0324 02:26:46.489355 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:26:48.115: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:48.115 (1.728s) < Exit [DeferCleanup (Each)] [sig-node] Security Context - dump namespaces | framework.go:209 @ 03/24/23 02:26:48.115 (1.728s) > Enter [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:26:48.116 STEP: Destroying namespace "security-context-test-3682" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:26:48.116 < Exit [DeferCleanup (Each)] [sig-node] Security Context - tear down framework | framework.go:206 @ 03/24/23 02:26:48.122 (7ms)
Find alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 mentions in log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSysctls\s\[LinuxOnly\]\s\[NodeConformance\]\sshould\ssupport\ssysctls\s\[MinimumKubeletVersion\:1\.21\]\s\[Conformance\]$'
[FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-3638/pods/sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898/log?container=test-container&previous=false": stream error: stream ID 1233; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:111 @ 03/24/23 02:35:26.876from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 02:35:22.837 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 02:35:22.837 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:35:22.837 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:35:22.837 STEP: Building a namespace api object, basename sysctl - test/e2e/framework/framework.go:250 @ 03/24/23 02:35:22.837 Mar 24 02:35:22.841: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:35:22.841 (4ms) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:22.841 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:22.841 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 02:35:22.841 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 02:35:22.841 (0s) > Enter [It] should support sysctls [MinimumKubeletVersion:1.21] [Conformance] - test/e2e/common/node/sysctl.go:77 @ 03/24/23 02:35:22.841 STEP: Creating a pod with the kernel.shm_rmid_forced sysctl - test/e2e/common/node/sysctl.go:89 @ 03/24/23 02:35:22.841 STEP: Watching for error events or started pod - test/e2e/common/node/sysctl.go:92 @ 03/24/23 02:35:22.863 STEP: Waiting for pod completion - test/e2e/common/node/sysctl.go:100 @ 03/24/23 02:35:24.867 STEP: Checking that the pod succeeded - test/e2e/common/node/sysctl.go:106 @ 03/24/23 02:35:26.873 STEP: Getting logs from the pod - test/e2e/common/node/sysctl.go:109 @ 03/24/23 02:35:26.873 Mar 24 02:35:26.876: INFO: Unexpected error: <*url.Error | 0xc000c85b00>: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-3638/pods/sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898/log?container=test-container&previous=false": stream error: stream ID 1233; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/sysctl-3638/pods/sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 1233, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-3638/pods/sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898/log?container=test-container&previous=false": stream error: stream ID 1233; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:111 @ 03/24/23 02:35:26.876 < Exit [It] should support sysctls [MinimumKubeletVersion:1.21] [Conformance] - test/e2e/common/node/sysctl.go:77 @ 03/24/23 02:35:26.876 (4.035s) > Enter [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:26.876 Mar 24 02:35:26.876: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:26.879 (3ms) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:26.879 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:26.879 (0s) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:35:26.879 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:26.879 STEP: Collecting events from namespace "sysctl-3638". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:35:26.879 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:35:26.883 Mar 24 02:35:26.883: INFO: At 2023-03-24 02:35:23 +0000 UTC - event for sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:35:26.883: INFO: At 2023-03-24 02:35:23 +0000 UTC - event for sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 02:35:26.883: INFO: At 2023-03-24 02:35:23 +0000 UTC - event for sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 02:35:26.885: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:35:26.885: INFO: sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:22 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:22 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:22 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:35:22 +0000 UTC }] Mar 24 02:35:26.885: INFO: Mar 24 02:35:26.888: INFO: Unable to fetch sysctl-3638/sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898/test-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-3638/pods/sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898/log?container=test-container&previous=false&tailLines=42": stream error: stream ID 1241; INTERNAL_ERROR; received from peer Mar 24 02:35:26.891: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:26.894: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:35:26.895: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:26.896: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:26.901: INFO: sysctl-2d24dd1c-9c5f-4dd8-b5fb-54a4a76c9898 started at 2023-03-24 02:35:22 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:26.901: INFO: Container test-container ready: false, restart count 0 Mar 24 02:35:26.901: INFO: static-pod-f3de9564-0369-4a2e-a776-2930fbc4275a-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:35:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:26.901: INFO: Container test ready: true, restart count 1 Mar 24 02:35:26.901: INFO: pod-secrets-501ce581-2611-4ac1-9b67-2e8433a689b2 started at 2023-03-24 02:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:26.901: INFO: Container secret-volume-test ready: false, restart count 0 Mar 24 02:35:26.901: INFO: busybox-2ac35595-9ff3-4ea2-b8d3-ac4a8a906b18 started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:26.901: INFO: Container busybox ready: false, restart count 0 Mar 24 02:35:26.901: INFO: pod-handle-http-request started at 2023-03-24 02:35:09 +0000 UTC (0+2 container statuses recorded) Mar 24 02:35:26.901: INFO: Container container-handle-http-request ready: true, restart count 0 Mar 24 02:35:26.901: INFO: Container container-handle-https-request ready: true, restart count 0 Mar 24 02:35:26.901: INFO: container-must-be-restarted started at 2023-03-24 02:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:26.901: INFO: Container regular-1 ready: false, restart count 0 Mar 24 02:35:26.901: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:35:26.901: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:35:26.901: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:35:26.901: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:35:26.901: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:26.901: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:35:26.901: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:26.901: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 W0324 02:35:26.902678 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:35:29.134: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:29.134 (2.255s) < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:35:29.135 (2.256s) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:35:29.135 STEP: Destroying namespace "sysctl-3638" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:35:29.135 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:35:29.171 (36ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sSysctls\s\[LinuxOnly\]\s\[NodeConformance\]\sshould\ssupport\ssysctls\swith\sslashes\sas\sseparator\s\[MinimumKubeletVersion\:1\.23\]$'
[FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7044/pods/sysctl-17682c63-ffd8-469f-8f32-93badb9f4318/log?container=test-container&previous=false": stream error: stream ID 539; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:220 @ 03/24/23 02:29:39.03from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 02:29:36.999 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:37 @ 03/24/23 02:29:36.999 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:29:36.999 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:29:36.999 STEP: Building a namespace api object, basename sysctl - test/e2e/framework/framework.go:250 @ 03/24/23 02:29:36.999 Mar 24 02:29:37.003: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - set up framework | framework.go:191 @ 03/24/23 02:29:37.003 (4ms) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:37.003 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:37.003 (0s) > Enter [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 02:29:37.003 < Exit [BeforeEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/common/node/sysctl.go:67 @ 03/24/23 02:29:37.003 (0s) > Enter [It] should support sysctls with slashes as separator [MinimumKubeletVersion:1.23] - test/e2e/common/node/sysctl.go:186 @ 03/24/23 02:29:37.003 STEP: Creating a pod with the kernel/shm_rmid_forced sysctl - test/e2e/common/node/sysctl.go:198 @ 03/24/23 02:29:37.003 STEP: Watching for error events or started pod - test/e2e/common/node/sysctl.go:201 @ 03/24/23 02:29:37.023 STEP: Waiting for pod completion - test/e2e/common/node/sysctl.go:209 @ 03/24/23 02:29:39.025 STEP: Checking that the pod succeeded - test/e2e/common/node/sysctl.go:215 @ 03/24/23 02:29:39.027 STEP: Getting logs from the pod - test/e2e/common/node/sysctl.go:218 @ 03/24/23 02:29:39.027 Mar 24 02:29:39.030: INFO: Unexpected error: <*url.Error | 0xc000ada390>: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7044/pods/sysctl-17682c63-ffd8-469f-8f32-93badb9f4318/log?container=test-container&previous=false": stream error: stream ID 539; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7044/pods/sysctl-17682c63-ffd8-469f-8f32-93badb9f4318/log?container=test-container&previous=false", Err: <http2.StreamError>{ StreamID: 539, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } [FAILED] Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7044/pods/sysctl-17682c63-ffd8-469f-8f32-93badb9f4318/log?container=test-container&previous=false": stream error: stream ID 539; INTERNAL_ERROR; received from peer In [It] at: test/e2e/common/node/sysctl.go:220 @ 03/24/23 02:29:39.03 < Exit [It] should support sysctls with slashes as separator [MinimumKubeletVersion:1.23] - test/e2e/common/node/sysctl.go:186 @ 03/24/23 02:29:39.03 (2.027s) > Enter [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:39.03 Mar 24 02:29:39.030: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:39.036 (6ms) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:39.036 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:39.036 (0s) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:29:39.036 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:29:39.036 STEP: Collecting events from namespace "sysctl-7044". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:29:39.036 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:29:39.038 Mar 24 02:29:39.038: INFO: At 2023-03-24 02:29:37 +0000 UTC - event for sysctl-17682c63-ffd8-469f-8f32-93badb9f4318: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:29:39.038: INFO: At 2023-03-24 02:29:37 +0000 UTC - event for sysctl-17682c63-ffd8-469f-8f32-93badb9f4318: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container test-container Mar 24 02:29:39.038: INFO: At 2023-03-24 02:29:37 +0000 UTC - event for sysctl-17682c63-ffd8-469f-8f32-93badb9f4318: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container test-container Mar 24 02:29:39.039: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:29:39.039: INFO: sysctl-17682c63-ffd8-469f-8f32-93badb9f4318 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:29:37 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:29:37 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:29:37 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:29:37 +0000 UTC }] Mar 24 02:29:39.039: INFO: Mar 24 02:29:39.041: INFO: Unable to fetch sysctl-7044/sysctl-17682c63-ffd8-469f-8f32-93badb9f4318/test-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/sysctl-7044/pods/sysctl-17682c63-ffd8-469f-8f32-93badb9f4318/log?container=test-container&previous=false&tailLines=42": stream error: stream ID 547; INTERNAL_ERROR; received from peer Mar 24 02:29:39.042: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:39.044: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:29:39.044: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:39.045: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:39.049: INFO: labelsupdate71fe31be-ea4e-4de4-a3c1-45b64a111644 started at 2023-03-24 02:28:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container client-container ready: true, restart count 0 Mar 24 02:29:39.049: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:29:39.049: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:29:39.049: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:29:39.049: INFO: pod-ready started at 2023-03-24 02:28:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 24 02:29:39.049: INFO: pod-exec-websocket-25235baf-2569-4a37-aaa3-c036b6ec1517 started at 2023-03-24 02:29:22 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container main ready: true, restart count 0 Mar 24 02:29:39.049: INFO: sysctl-17682c63-ffd8-469f-8f32-93badb9f4318 started at 2023-03-24 02:29:37 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container test-container ready: false, restart count 0 Mar 24 02:29:39.049: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container back-off ready: false, restart count 4 Mar 24 02:29:39.049: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:29:39.049: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:29:39.049: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:29:39.049: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:29:39.049: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:39.049: INFO: Container image-pull-test ready: false, restart count 0 W0324 02:29:39.050687 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:29:39.107: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:29:39.107 (71ms) < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - dump namespaces | framework.go:209 @ 03/24/23 02:29:39.107 (71ms) > Enter [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:29:39.107 STEP: Destroying namespace "sysctl-7044" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:29:39.107 < Exit [DeferCleanup (Each)] [sig-node] Sysctls [LinuxOnly] [NodeConformance] - tear down framework | framework.go:206 @ 03/24/23 02:29:39.11 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sVariable\sExpansion\sshould\sallow\scomposing\senv\svars\sinto\snew\senv\svars\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-5018/pods/var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281/log?container=dapi-container&previous=false": stream error: stream ID 657; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:07.359from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 02:35:03.294 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:35:03.294 STEP: Building a namespace api object, basename var-expansion - test/e2e/framework/framework.go:250 @ 03/24/23 02:35:03.294 Mar 24 02:35:03.302: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 02:35:03.302 (8ms) > Enter [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:03.302 < Exit [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:03.302 (0s) > Enter [It] should allow composing env vars into new env vars [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:47 @ 03/24/23 02:35:03.302 STEP: Creating a pod to test env composition - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:35:03.302 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:35:07.351 Mar 24 02:35:07.352: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281 container dapi-container: <nil> Mar 24 02:35:07.354: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-5018/pods/var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281/log?container=dapi-container&previous=false": stream error: stream ID 657; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:35:07.354 Mar 24 02:35:07.359: INFO: Unexpected error: <*fmt.wrapError | 0xc0015adb40>: failed to get logs from var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-5018/pods/var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281/log?container=dapi-container&previous=false": stream error: stream ID 657; INTERNAL_ERROR; received from peer { msg: "failed to get logs from var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/var-expansion-5018/pods/var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281/log?container=dapi-container&previous=false\": stream error: stream ID 657; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000a6c930>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-5018/pods/var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 657, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-5018/pods/var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281/log?container=dapi-container&previous=false": stream error: stream ID 657; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:07.359 < Exit [It] should allow composing env vars into new env vars [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:47 @ 03/24/23 02:35:07.359 (4.057s) > Enter [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:07.359 Mar 24 02:35:07.359: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:07.361 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:07.361 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:07.361 (0s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 02:35:07.361 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:07.361 STEP: Collecting events from namespace "var-expansion-5018". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:35:07.361 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:35:07.362 Mar 24 02:35:07.362: INFO: At 2023-03-24 02:35:04 +0000 UTC - event for var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:35:07.362: INFO: At 2023-03-24 02:35:04 +0000 UTC - event for var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:35:07.362: INFO: At 2023-03-24 02:35:04 +0000 UTC - event for var-expansion-aa9ec638-52be-4b6f-8671-d4962ccd8281: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:35:07.363: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:35:07.363: INFO: Mar 24 02:35:07.364: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:07.366: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:35:07.366: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:07.367: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:07.370: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:35:07.370: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:35:07.370: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:35:07.370: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:35:07.370: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:07.370: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:35:07.370: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:07.370: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:35:07.370: INFO: static-pod-f3de9564-0369-4a2e-a776-2930fbc4275a-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:35:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:07.370: INFO: Container test ready: false, restart count 0 Mar 24 02:35:07.370: INFO: pod-projected-secrets-e5ce8902-9e84-49ff-a217-af38ab269b21 started at 2023-03-24 02:35:04 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:07.370: INFO: Container projected-secret-volume-test ready: false, restart count 0 Mar 24 02:35:07.370: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:07.370: INFO: Container client-container ready: false, restart count 0 Mar 24 02:35:07.370: INFO: pod-secrets-6e661922-2398-4d4d-9904-b746eade53d2 started at 2023-03-24 02:35:04 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:07.370: INFO: Container secret-volume-test ready: false, restart count 0 W0324 02:35:07.371770 1163 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:35:09.310: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:09.31 (1.95s) < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 02:35:09.31 (1.95s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 02:35:09.31 STEP: Destroying namespace "var-expansion-5018" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:35:09.31 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 02:35:09.317 (7ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sVariable\sExpansion\sshould\sallow\ssubstituting\svalues\sin\sa\scontainer\'s\sargs\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-8631/pods/var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8/log?container=dapi-container&previous=false": stream error: stream ID 93; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:46.36from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 02:27:40.285 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:27:40.285 STEP: Building a namespace api object, basename var-expansion - test/e2e/framework/framework.go:250 @ 03/24/23 02:27:40.285 Mar 24 02:27:40.294: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 02:27:40.294 (9ms) > Enter [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:40.294 < Exit [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:40.294 (0s) > Enter [It] should allow substituting values in a container's args [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:95 @ 03/24/23 02:27:40.294 STEP: Creating a pod to test substitution in container's args - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:27:40.295 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:27:46.351 Mar 24 02:27:46.352: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8 container dapi-container: <nil> Mar 24 02:27:46.354: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-8631/pods/var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8/log?container=dapi-container&previous=false": stream error: stream ID 93; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:27:46.354 Mar 24 02:27:46.360: INFO: Unexpected error: <*fmt.wrapError | 0xc0003713a0>: failed to get logs from var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-8631/pods/var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8/log?container=dapi-container&previous=false": stream error: stream ID 93; INTERNAL_ERROR; received from peer { msg: "failed to get logs from var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/var-expansion-8631/pods/var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8/log?container=dapi-container&previous=false\": stream error: stream ID 93; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0011a53b0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-8631/pods/var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 93, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-8631/pods/var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8/log?container=dapi-container&previous=false": stream error: stream ID 93; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:46.36 < Exit [It] should allow substituting values in a container's args [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:95 @ 03/24/23 02:27:46.36 (6.065s) > Enter [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:46.36 Mar 24 02:27:46.360: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:46.361 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:46.361 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:46.361 (0s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 02:27:46.361 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:46.361 STEP: Collecting events from namespace "var-expansion-8631". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:27:46.362 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:27:46.363 Mar 24 02:27:46.363: INFO: At 2023-03-24 02:27:42 +0000 UTC - event for var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:27:46.363: INFO: At 2023-03-24 02:27:42 +0000 UTC - event for var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:27:46.363: INFO: At 2023-03-24 02:27:42 +0000 UTC - event for var-expansion-a8270afc-013f-42f1-80fb-81aee32afcb8: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:27:46.364: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:27:46.364: INFO: Mar 24 02:27:46.366: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:46.367: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:27:46.367: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:46.368: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:46.372: INFO: test-webserver-37d56ffe-a0ed-4d9b-ad1c-8044529376fb started at 2023-03-24 02:27:21 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container test-webserver ready: false, restart count 0 Mar 24 02:27:46.372: INFO: pod-update-activedeadlineseconds-1db3ec8b-e3b7-4c59-b9a8-cf92e47ca485 started at 2023-03-24 02:27:35 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container pause ready: false, restart count 0 Mar 24 02:27:46.372: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:27:46.372: INFO: test-container-pod started at 2023-03-24 02:27:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container webserver ready: true, restart count 0 Mar 24 02:27:46.372: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:27:46.372: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container client-container ready: true, restart count 0 Mar 24 02:27:46.372: INFO: host-test-container-pod started at 2023-03-24 02:27:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:27:46.372: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container back-off ready: true, restart count 3 Mar 24 02:27:46.372: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:27:46.372: INFO: netserver-0 started at 2023-03-24 02:27:17 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:46.372: INFO: Container webserver ready: true, restart count 0 W0324 02:27:46.373591 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:27:48.116: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:48.116 (1.755s) < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 02:27:48.117 (1.755s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 02:27:48.117 STEP: Destroying namespace "var-expansion-8631" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:27:48.117 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 02:27:48.122 (5ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-node\]\sVariable\sExpansion\sshould\sallow\ssubstituting\svalues\sin\sa\scontainer\'s\scommand\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-943/pods/var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28/log?container=dapi-container&previous=false": stream error: stream ID 1517; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:04.254from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 02:36:00.209 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:00.209 STEP: Building a namespace api object, basename var-expansion - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:00.209 Mar 24 02:36:00.212: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-node] Variable Expansion - set up framework | framework.go:191 @ 03/24/23 02:36:00.212 (4ms) > Enter [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:00.212 < Exit [BeforeEach] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:00.212 (0s) > Enter [It] should allow substituting values in a container's command [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:76 @ 03/24/23 02:36:00.212 STEP: Creating a pod to test substitution in container's command - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:36:00.212 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:36:04.246 Mar 24 02:36:04.247: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28 container dapi-container: <nil> Mar 24 02:36:04.249: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28" container "dapi-container". Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-943/pods/var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28/log?container=dapi-container&previous=false": stream error: stream ID 1517; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:36:04.249 Mar 24 02:36:04.254: INFO: Unexpected error: <*fmt.wrapError | 0xc000b40c20>: failed to get logs from var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-943/pods/var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28/log?container=dapi-container&previous=false": stream error: stream ID 1517; INTERNAL_ERROR; received from peer { msg: "failed to get logs from var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28 for dapi-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/var-expansion-943/pods/var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28/log?container=dapi-container&previous=false\": stream error: stream ID 1517; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00194f1d0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-943/pods/var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28/log?container=dapi-container&previous=false", Err: <http2.StreamError>{ StreamID: 1517, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28 for dapi-container: Get "https://127.0.0.1:6443/api/v1/namespaces/var-expansion-943/pods/var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28/log?container=dapi-container&previous=false": stream error: stream ID 1517; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:04.254 < Exit [It] should allow substituting values in a container's command [NodeConformance] [Conformance] - test/e2e/common/node/expansion.go:76 @ 03/24/23 02:36:04.254 (4.042s) > Enter [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:04.254 Mar 24 02:36:04.254: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-node] Variable Expansion - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:04.256 (2ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:04.256 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:04.256 (0s) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 02:36:04.256 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:04.256 STEP: Collecting events from namespace "var-expansion-943". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:04.256 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:04.257 Mar 24 02:36:04.257: INFO: At 2023-03-24 02:36:00 +0000 UTC - event for var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:36:04.257: INFO: At 2023-03-24 02:36:00 +0000 UTC - event for var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container dapi-container Mar 24 02:36:04.257: INFO: At 2023-03-24 02:36:00 +0000 UTC - event for var-expansion-5cac9326-1317-40d6-8ce8-d7dff3c0df28: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container dapi-container Mar 24 02:36:04.258: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:04.258: INFO: Mar 24 02:36:04.260: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:04.261: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:04.261: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:04.262: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:04.267: INFO: alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 started at 2023-03-24 02:35:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container alpine-nnp-nil-83b50b2d-0e51-42ef-9fb1-b58978b469d9 ready: false, restart count 0 Mar 24 02:36:04.267: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:04.267: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container agnhost-container ready: true, restart count 1 Mar 24 02:36:04.267: INFO: busybox-2ac35595-9ff3-4ea2-b8d3-ac4a8a906b18 started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container busybox ready: false, restart count 0 Mar 24 02:36:04.267: INFO: container-must-be-restarted started at 2023-03-24 02:35:26 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container regular-1 ready: false, restart count 2 Mar 24 02:36:04.267: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:04.267: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:04.267: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:04.267: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:36:04.267: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:36:04.267: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:04.267: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:04.267: INFO: Container busybox-container ready: true, restart count 1 W0324 02:36:04.268351 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:04.324: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:04.324 (68ms) < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - dump namespaces | framework.go:209 @ 03/24/23 02:36:04.324 (68ms) > Enter [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 02:36:04.324 STEP: Destroying namespace "var-expansion-943" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:04.324 < Exit [DeferCleanup (Each)] [sig-node] Variable Expansion - tear down framework | framework.go:206 @ 03/24/23 02:36:04.327 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sbinary\sdata\sshould\sbe\sreflected\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 240.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc001658450>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4052/pods/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/log?container=agnhost-container&previous=false": stream error: stream ID 823; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-4052/pods/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 823, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:230 @ 03/24/23 02:34:35.185from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:30:31.153 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:30:31.153 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:30:31.153 Mar 24 02:30:31.156: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:30:31.156 (4ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:31.156 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:31.156 (0s) > Enter [It] binary data should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:175 @ 03/24/23 02:30:31.156 Mar 24 02:30:31.158: INFO: Couldn't get node TTL annotation (using default value of 0): No TTL annotation found on the node STEP: Creating configMap with name configmap-test-upd-9a6738b7-d752-46fc-b01d-180a9e3663f0 - test/e2e/common/storage/configmap_volume.go:197 @ 03/24/23 02:30:31.158 STEP: Creating the pod - test/e2e/common/storage/configmap_volume.go:218 @ 03/24/23 02:30:31.16 STEP: Waiting for pod with text data - test/e2e/common/storage/configmap_volume.go:229 @ 03/24/23 02:30:35.183 [FAILED] Timed out after 240.001s. The function passed to Eventually returned the following error: <*url.Error | 0xc001658450>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4052/pods/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/log?container=agnhost-container&previous=false": stream error: stream ID 823; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-4052/pods/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 823, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:230 @ 03/24/23 02:34:35.185 < Exit [It] binary data should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:175 @ 03/24/23 02:34:35.185 (4m4.028s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:35.185 Mar 24 02:34:35.185: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:34:35.188 (4ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:35.188 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:34:35.189 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:34:35.189 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:35.189 STEP: Collecting events from namespace "configmap-4052". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:34:35.189 STEP: Found 6 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:34:35.195 Mar 24 02:34:35.195: INFO: At 2023-03-24 02:30:32 +0000 UTC - event for pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:34:35.195: INFO: At 2023-03-24 02:30:32 +0000 UTC - event for pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:34:35.195: INFO: At 2023-03-24 02:30:33 +0000 UTC - event for pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:34:35.195: INFO: At 2023-03-24 02:30:33 +0000 UTC - event for pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Mar 24 02:34:35.195: INFO: At 2023-03-24 02:30:33 +0000 UTC - event for pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container configmap-volume-binary-test Mar 24 02:34:35.195: INFO: At 2023-03-24 02:30:33 +0000 UTC - event for pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container configmap-volume-binary-test Mar 24 02:34:35.200: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:34:35.200: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:31 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:31 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:31 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:30:31 +0000 UTC }] Mar 24 02:34:35.201: INFO: Mar 24 02:34:35.207: INFO: Unable to fetch configmap-4052/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4052/pods/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 831; INTERNAL_ERROR; received from peer Mar 24 02:34:35.209: INFO: Unable to fetch configmap-4052/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/configmap-volume-binary-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-4052/pods/pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c/log?container=configmap-volume-binary-test&previous=false&tailLines=42": stream error: stream ID 833; INTERNAL_ERROR; received from peer Mar 24 02:34:35.219: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:35.225: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:34:35.226: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:35.231: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:34:35.251: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:34:35.251: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 02:34:35.251: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:34:35.251: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:34:35.251: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:34:35.251: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:34:35.251: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:34:35.251: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:34:35.251: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:34:35.251: INFO: busybox-85dd7a8e-4f0e-4163-bb8b-419e26beadc2 started at 2023-03-24 02:34:05 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container busybox ready: true, restart count 0 Mar 24 02:34:35.251: INFO: busybox-readonly-false-b21cde68-c7cb-4ff6-b2eb-a126403e4ff0 started at 2023-03-24 02:34:34 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container busybox-readonly-false-b21cde68-c7cb-4ff6-b2eb-a126403e4ff0 ready: false, restart count 0 Mar 24 02:34:35.251: INFO: ephemeral-containers-target-pod started at 2023-03-24 02:34:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 02:34:35.251: INFO: busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df started at 2023-03-24 02:33:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container busybox-scheduling-c3648a6a-0775-4896-8296-456c64dfa2df ready: true, restart count 0 Mar 24 02:34:35.251: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:34:35.251: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:34:35.251: INFO: Container client-container ready: false, restart count 0 W0324 02:34:35.260801 1160 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:34:35.976: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:34:35.976 (788ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:34:35.976 (788ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:34:35.976 STEP: Destroying namespace "configmap-4052" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:34:35.976 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:34:35.996 (19ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\soptional\supdates\sshould\sbe\sreflected\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 240.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc0010fc3f0>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6889/pods/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/log?container=createcm-volume-test&previous=false": stream error: stream ID 679; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-6889/pods/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/log?container=createcm-volume-test&previous=false", Err: <http2.StreamError>{ StreamID: 679, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:383 @ 03/24/23 02:31:52.574from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:48.352 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:27:48.352 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:27:48.353 Mar 24 02:27:48.425: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:48.425 (72ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:48.425 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:48.425 (0s) > Enter [It] optional updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:240 @ 03/24/23 02:27:48.425 Mar 24 02:27:48.435: INFO: Couldn't get node TTL annotation (using default value of 0): No TTL annotation found on the node STEP: Creating configMap with name cm-test-opt-del-2844ba5b-e16e-42ba-bad1-920c38896533 - test/e2e/common/storage/configmap_volume.go:285 @ 03/24/23 02:27:48.435 STEP: Creating configMap with name cm-test-opt-upd-9400be20-a2c1-4ad0-bbd8-13c9b0622cb7 - test/e2e/common/storage/configmap_volume.go:291 @ 03/24/23 02:27:48.448 STEP: Creating the pod - test/e2e/common/storage/configmap_volume.go:377 @ 03/24/23 02:27:48.458 [FAILED] Timed out after 240.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc0010fc3f0>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6889/pods/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/log?container=createcm-volume-test&previous=false": stream error: stream ID 679; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-6889/pods/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/log?container=createcm-volume-test&previous=false", Err: <http2.StreamError>{ StreamID: 679, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:383 @ 03/24/23 02:31:52.574 < Exit [It] optional updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:240 @ 03/24/23 02:31:52.574 (4m4.149s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:52.574 Mar 24 02:31:52.574: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:52.594 (20ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:52.594 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:52.594 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:31:52.594 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:52.594 STEP: Collecting events from namespace "configmap-6889". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:31:52.594 STEP: Found 9 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:31:52.601 Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container delcm-volume-test Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container delcm-volume-test Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container updcm-volume-test Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container updcm-volume-test Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container createcm-volume-test Mar 24 02:31:52.601: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container createcm-volume-test Mar 24 02:31:52.609: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:31:52.609: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:27:48 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:31:51 +0000 UTC PodFailed } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:31:51 +0000 UTC PodFailed } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:27:48 +0000 UTC }] Mar 24 02:31:52.609: INFO: Mar 24 02:31:52.614: INFO: Unable to fetch configmap-6889/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/delcm-volume-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6889/pods/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/log?container=delcm-volume-test&previous=false&tailLines=42": stream error: stream ID 687; INTERNAL_ERROR; received from peer Mar 24 02:31:52.616: INFO: Unable to fetch configmap-6889/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/updcm-volume-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6889/pods/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/log?container=updcm-volume-test&previous=false&tailLines=42": stream error: stream ID 689; INTERNAL_ERROR; received from peer Mar 24 02:31:52.620: INFO: Unable to fetch configmap-6889/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/createcm-volume-test logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6889/pods/pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400/log?container=createcm-volume-test&previous=false&tailLines=42": stream error: stream ID 691; INTERNAL_ERROR; received from peer Mar 24 02:31:52.623: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:52.627: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:31:52.627: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:52.631: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:52.637: INFO: pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e started at 2023-03-24 02:31:50 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:52.637: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 02:31:52.637: INFO: image-pull-testbda2773d-0d8c-494f-a72f-841b434347e9 started at 2023-03-24 02:31:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:52.637: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:31:52.637: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:52.637: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:31:52.637: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:52.637: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:52.637: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:31:52.637: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:52.637: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:31:52.637: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:52.637: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:31:52.637: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:31:52.637: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:31:52.637: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:52.637: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:31:52.637: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:52.637: INFO: Container createcm-volume-test ready: false, restart count 0 Mar 24 02:31:52.637: INFO: Container delcm-volume-test ready: false, restart count 0 Mar 24 02:31:52.637: INFO: Container updcm-volume-test ready: false, restart count 0 W0324 02:31:52.640687 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:31:52.704: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:52.704 (110ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:31:52.704 (110ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:31:52.704 STEP: Destroying namespace "configmap-6889" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:31:52.704 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:31:52.71 (6ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-2282/pods/pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e/log?container=agnhost-container&previous=false": stream error: stream ID 545; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:31:54.845from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:31:50.774 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:31:50.774 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:31:50.774 Mar 24 02:31:50.790: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:31:50.79 (16ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:31:50.79 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:31:50.79 (0s) > Enter [It] should be consumable from pods in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:47 @ 03/24/23 02:31:50.79 STEP: Creating configMap with name configmap-test-volume-63349c5d-f401-4a1d-ad2f-e031cfc6a629 - test/e2e/common/storage/configmap_volume.go:599 @ 03/24/23 02:31:50.79 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:31:50.793 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:31:54.836 Mar 24 02:31:54.838: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e container agnhost-container: <nil> Mar 24 02:31:54.839: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-2282/pods/pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e/log?container=agnhost-container&previous=false": stream error: stream ID 545; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:31:54.839 Mar 24 02:31:54.845: INFO: Unexpected error: <*fmt.wrapError | 0xc000a2fe80>: failed to get logs from pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-2282/pods/pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e/log?container=agnhost-container&previous=false": stream error: stream ID 545; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-2282/pods/pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e/log?container=agnhost-container&previous=false\": stream error: stream ID 545; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc0011aa150>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-2282/pods/pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 545, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-2282/pods/pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e/log?container=agnhost-container&previous=false": stream error: stream ID 545; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:31:54.845 < Exit [It] should be consumable from pods in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:47 @ 03/24/23 02:31:54.845 (4.055s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:54.845 Mar 24 02:31:54.845: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:31:54.846 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:54.846 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:31:54.846 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:31:54.847 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:54.847 STEP: Collecting events from namespace "configmap-2282". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:31:54.847 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:31:54.848 Mar 24 02:31:54.848: INFO: At 2023-03-24 02:31:51 +0000 UTC - event for pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:31:54.848: INFO: At 2023-03-24 02:31:51 +0000 UTC - event for pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:31:54.848: INFO: At 2023-03-24 02:31:51 +0000 UTC - event for pod-configmaps-bb6e4cf4-3745-42f6-a288-635b2e02772e: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:31:54.849: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:31:54.849: INFO: Mar 24 02:31:54.854: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:54.859: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:31:54.859: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:54.861: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:31:54.873: INFO: downwardapi-volume-8630bb5d-ab8e-412d-94b7-44dccebdd005 started at 2023-03-24 02:31:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:54.873: INFO: Container client-container ready: false, restart count 0 Mar 24 02:31:54.873: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:54.873: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:31:54.873: INFO: pod-projected-configmaps-5300cb92-6136-4755-b4bd-4d01c79fa421 started at 2023-03-24 02:30:56 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:54.873: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:54.873: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:31:54.873: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:31:54.873: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:31:54.873: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:54.873: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:31:54.873: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:31:54.873: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:31:54.873: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:54.873: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:31:54.873: INFO: netserver-0 started at 2023-03-24 02:31:52 +0000 UTC (0+1 container statuses recorded) Mar 24 02:31:54.873: INFO: Container webserver ready: false, restart count 0 Mar 24 02:31:54.873: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:31:54.873: INFO: Container createcm-volume-test ready: false, restart count 0 Mar 24 02:31:54.873: INFO: Container delcm-volume-test ready: false, restart count 0 Mar 24 02:31:54.873: INFO: Container updcm-volume-test ready: false, restart count 0 W0324 02:31:54.876660 1159 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:31:54.936: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:31:54.936 (89ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:31:54.936 (89ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:31:54.936 STEP: Destroying namespace "configmap-2282" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:31:54.936 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:31:54.938 (2ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\sas\snon\-root\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6364/pods/pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3/log?container=agnhost-container&previous=false": stream error: stream ID 501; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:29:36.916from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:29:32.857 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:29:32.857 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:29:32.857 Mar 24 02:29:32.861: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:29:32.861 (4ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:32.861 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:32.861 (0s) > Enter [It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:74 @ 03/24/23 02:29:32.861 STEP: Creating configMap with name configmap-test-volume-95fa7050-bcd0-4d66-8501-22ee352674ce - test/e2e/common/storage/configmap_volume.go:599 @ 03/24/23 02:29:32.861 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:29:32.863 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:29:36.904 Mar 24 02:29:36.908: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3 container agnhost-container: <nil> Mar 24 02:29:36.910: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6364/pods/pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3/log?container=agnhost-container&previous=false": stream error: stream ID 501; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:29:36.91 Mar 24 02:29:36.916: INFO: Unexpected error: <*fmt.wrapError | 0xc000af3f00>: failed to get logs from pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6364/pods/pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3/log?container=agnhost-container&previous=false": stream error: stream ID 501; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-6364/pods/pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3/log?container=agnhost-container&previous=false\": stream error: stream ID 501; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00117db60>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-6364/pods/pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 501, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6364/pods/pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3/log?container=agnhost-container&previous=false": stream error: stream ID 501; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:29:36.916 < Exit [It] should be consumable from pods in volume as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:74 @ 03/24/23 02:29:36.916 (4.055s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:36.916 Mar 24 02:29:36.916: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:36.918 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:36.918 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:36.918 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:29:36.918 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:29:36.918 STEP: Collecting events from namespace "configmap-6364". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:29:36.918 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:29:36.919 Mar 24 02:29:36.919: INFO: At 2023-03-24 02:29:33 +0000 UTC - event for pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:29:36.919: INFO: At 2023-03-24 02:29:33 +0000 UTC - event for pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:29:36.919: INFO: At 2023-03-24 02:29:33 +0000 UTC - event for pod-configmaps-da6d4419-a8ca-4c8b-b075-0c8228b8cbe3: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:29:36.920: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:29:36.920: INFO: Mar 24 02:29:36.921: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:36.922: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:29:36.923: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:36.924: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:36.927: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:29:36.927: INFO: labelsupdate71fe31be-ea4e-4de4-a3c1-45b64a111644 started at 2023-03-24 02:28:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container client-container ready: true, restart count 0 Mar 24 02:29:36.927: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:29:36.927: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:29:36.927: INFO: pod-ready started at 2023-03-24 02:28:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 24 02:29:36.927: INFO: pod-exec-websocket-25235baf-2569-4a37-aaa3-c036b6ec1517 started at 2023-03-24 02:29:22 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container main ready: true, restart count 0 Mar 24 02:29:36.927: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container back-off ready: false, restart count 4 Mar 24 02:29:36.927: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:29:36.927: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:29:36.927: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:29:36.927: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:29:36.927: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:36.927: INFO: Container image-pull-test ready: false, restart count 0 W0324 02:29:36.928944 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:29:36.993: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:29:36.994 (76ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:29:36.994 (76ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:29:36.994 STEP: Destroying namespace "configmap-6364" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:29:36.994 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:29:36.997 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\sdefaultMode\sset\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3747/pods/pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17/log?container=agnhost-container&previous=false": stream error: stream ID 25; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:42.18from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:26:29.687 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:26:29.688 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:26:29.689 Mar 24 02:26:29.818: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:26:29.818 (130ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:29.818 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:29.818 (0s) > Enter [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:57 @ 03/24/23 02:26:29.818 STEP: Creating configMap with name configmap-test-volume-d22f81a7-fdf8-4b31-9c4e-9f48461cc633 - test/e2e/common/storage/configmap_volume.go:599 @ 03/24/23 02:26:29.818 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:26:29.894 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:26:42.086 Mar 24 02:26:42.098: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17 container agnhost-container: <nil> Mar 24 02:26:42.109: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3747/pods/pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17/log?container=agnhost-container&previous=false": stream error: stream ID 25; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:26:42.109 Mar 24 02:26:42.180: INFO: Unexpected error: <*fmt.wrapError | 0xc000210bc0>: failed to get logs from pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3747/pods/pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17/log?container=agnhost-container&previous=false": stream error: stream ID 25; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-3747/pods/pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17/log?container=agnhost-container&previous=false\": stream error: stream ID 25; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00113bc80>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-3747/pods/pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 25, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3747/pods/pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17/log?container=agnhost-container&previous=false": stream error: stream ID 25; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:42.18 < Exit [It] should be consumable from pods in volume with defaultMode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:57 @ 03/24/23 02:26:42.18 (12.363s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:42.18 Mar 24 02:26:42.180: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:42.204 (24ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:42.204 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:42.204 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:26:42.204 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:42.204 STEP: Collecting events from namespace "configmap-3747". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:26:42.204 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:26:42.216 Mar 24 02:26:42.216: INFO: At 2023-03-24 02:26:36 +0000 UTC - event for pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:26:42.216: INFO: At 2023-03-24 02:26:37 +0000 UTC - event for pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:26:42.216: INFO: At 2023-03-24 02:26:38 +0000 UTC - event for pod-configmaps-b7c83c5b-55aa-455c-bd8b-108b97cdab17: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:26:42.220: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:26:42.220: INFO: Mar 24 02:26:42.230: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:42.238: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 86 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:29 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:26:42.238: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:42.297: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:42.358: INFO: deleted-running-always-25cfff4e-6dbd-4272-8185-1168c6b7b044 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.358: INFO: Container deleted-running-always-25cfff4e-6dbd-4272-8185-1168c6b7b044 ready: true, restart count 0 Mar 24 02:26:42.358: INFO: alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 started at <nil> (0+0 container statuses recorded) Mar 24 02:26:42.358: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.358: INFO: Container back-off ready: true, restart count 0 Mar 24 02:26:42.358: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.358: INFO: Container client-container ready: true, restart count 0 Mar 24 02:26:42.358: INFO: pod58adf7cd-4828-42b8-a5ed-9cea0cc6f487 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.358: INFO: Container containerad81c6b1-3fd8-40bc-94d9-7e998c87e7e0 ready: false, restart count 0 Mar 24 02:26:42.358: INFO: termination-message-container900e0768-2c53-49c2-9916-d93aee5cce1d started at 2023-03-24 02:26:41 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:42.358: INFO: Container termination-message-container ready: false, restart count 0 W0324 02:26:42.374768 1163 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:26:45.018: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:45.018 (2.814s) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:26:45.018 (2.814s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:26:45.018 STEP: Destroying namespace "configmap-3747" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:26:45.023 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:26:45.039 (21ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\smappings\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5274/pods/pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27/log?container=agnhost-container&previous=false": stream error: stream ID 135; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:52.207from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:48.123 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:27:48.123 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:27:48.123 Mar 24 02:27:48.133: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:48.133 (10ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:48.133 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:48.133 (0s) > Enter [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:89 @ 03/24/23 02:27:48.133 STEP: Creating configMap with name configmap-test-volume-map-d3cba016-0d61-4ab7-bde9-cf7f68c8dc7d - test/e2e/common/storage/configmap_volume.go:640 @ 03/24/23 02:27:48.133 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:27:48.137 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:27:52.197 Mar 24 02:27:52.198: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27 container agnhost-container: <nil> Mar 24 02:27:52.201: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5274/pods/pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27/log?container=agnhost-container&previous=false": stream error: stream ID 135; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:27:52.201 Mar 24 02:27:52.207: INFO: Unexpected error: <*fmt.wrapError | 0xc0010e8680>: failed to get logs from pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5274/pods/pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27/log?container=agnhost-container&previous=false": stream error: stream ID 135; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-5274/pods/pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27/log?container=agnhost-container&previous=false\": stream error: stream ID 135; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00113a420>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-5274/pods/pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 135, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-5274/pods/pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27/log?container=agnhost-container&previous=false": stream error: stream ID 135; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:52.207 < Exit [It] should be consumable from pods in volume with mappings [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:89 @ 03/24/23 02:27:52.207 (4.074s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:52.207 Mar 24 02:27:52.207: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:52.209 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:52.209 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:52.209 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:27:52.209 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:52.209 STEP: Collecting events from namespace "configmap-5274". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:27:52.209 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:27:52.21 Mar 24 02:27:52.210: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:27:52.210: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:27:52.210: INFO: At 2023-03-24 02:27:50 +0000 UTC - event for pod-configmaps-81180999-4a57-4be7-bdcd-3d1daa6e2d27: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:27:52.211: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:27:52.211: INFO: Mar 24 02:27:52.213: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:52.214: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:27:52.214: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:52.215: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:52.219: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:52.219: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:27:52.219: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:52.219: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:27:52.219: INFO: test-webserver-37d56ffe-a0ed-4d9b-ad1c-8044529376fb started at 2023-03-24 02:27:21 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:52.219: INFO: Container test-webserver ready: false, restart count 0 Mar 24 02:27:52.219: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:52.219: INFO: Container back-off ready: false, restart count 3 Mar 24 02:27:52.219: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:27:52.219: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:27:52.219: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:27:52.219: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:27:52.219: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:52.219: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:27:52.219: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:52.219: INFO: Container client-container ready: true, restart count 0 W0324 02:27:52.220019 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:27:54.351: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:54.351 (2.143s) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:27:54.353 (2.144s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:27:54.353 STEP: Destroying namespace "configmap-5274" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:27:54.353 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:27:54.356 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\smappings\sand\sItem\smode\sset\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-1234/pods/pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2/log?container=agnhost-container&previous=false": stream error: stream ID 459; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:29:32.787from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:29:28.702 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:29:28.702 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:29:28.702 Mar 24 02:29:28.706: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:29:28.706 (4ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:28.706 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:28.706 (0s) > Enter [It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:99 @ 03/24/23 02:29:28.706 STEP: Creating configMap with name configmap-test-volume-map-dba26464-f31a-4474-9853-f7de86340c92 - test/e2e/common/storage/configmap_volume.go:640 @ 03/24/23 02:29:28.706 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:29:28.759 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:29:32.778 Mar 24 02:29:32.780: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2 container agnhost-container: <nil> Mar 24 02:29:32.782: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-1234/pods/pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2/log?container=agnhost-container&previous=false": stream error: stream ID 459; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:29:32.782 Mar 24 02:29:32.787: INFO: Unexpected error: <*fmt.wrapError | 0xc0018d3d60>: failed to get logs from pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-1234/pods/pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2/log?container=agnhost-container&previous=false": stream error: stream ID 459; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2 for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-1234/pods/pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2/log?container=agnhost-container&previous=false\": stream error: stream ID 459; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000c14990>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-1234/pods/pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 459, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2 for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-1234/pods/pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2/log?container=agnhost-container&previous=false": stream error: stream ID 459; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:29:32.787 < Exit [It] should be consumable from pods in volume with mappings and Item mode set [LinuxOnly] [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:99 @ 03/24/23 02:29:32.787 (4.081s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:32.787 Mar 24 02:29:32.787: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:32.789 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:32.789 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:32.789 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:29:32.789 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:29:32.789 STEP: Collecting events from namespace "configmap-1234". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:29:32.789 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:29:32.79 Mar 24 02:29:32.790: INFO: At 2023-03-24 02:29:29 +0000 UTC - event for pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:29:32.790: INFO: At 2023-03-24 02:29:29 +0000 UTC - event for pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:29:32.790: INFO: At 2023-03-24 02:29:29 +0000 UTC - event for pod-configmaps-33d02a3c-1227-4148-bed0-916572a691d2: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:29:32.791: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:29:32.791: INFO: Mar 24 02:29:32.793: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:32.794: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:29:32.795: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:32.796: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:32.800: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container back-off ready: false, restart count 4 Mar 24 02:29:32.800: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:29:32.800: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:29:32.800: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:29:32.800: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:29:32.800: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:29:32.800: INFO: pod-ready started at 2023-03-24 02:28:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container pod-readiness-gate ready: true, restart count 0 Mar 24 02:29:32.800: INFO: pod-exec-websocket-25235baf-2569-4a37-aaa3-c036b6ec1517 started at 2023-03-24 02:29:22 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container main ready: true, restart count 0 Mar 24 02:29:32.800: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:29:32.800: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:29:32.800: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:29:32.800: INFO: labelsupdate71fe31be-ea4e-4de4-a3c1-45b64a111644 started at 2023-03-24 02:28:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:29:32.800: INFO: Container client-container ready: true, restart count 0 W0324 02:29:32.801849 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:29:32.852: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:29:32.852 (63ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:29:32.852 (63ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:29:32.852 STEP: Destroying namespace "configmap-1234" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:29:32.853 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:29:32.855 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sfrom\spods\sin\svolume\swith\smappings\sas\snon\-root\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6172/pods/pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af/log?container=agnhost-container&previous=false": stream error: stream ID 167; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:05.662from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:01.624 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:27:01.624 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:27:01.624 Mar 24 02:27:01.628: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:27:01.628 (4ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:01.628 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:27:01.628 (0s) > Enter [It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:109 @ 03/24/23 02:27:01.628 STEP: Creating configMap with name configmap-test-volume-map-ea40d753-e0f7-46f3-a920-37006b71d93f - test/e2e/common/storage/configmap_volume.go:640 @ 03/24/23 02:27:01.628 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:27:01.63 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:27:05.654 Mar 24 02:27:05.655: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af container agnhost-container: <nil> Mar 24 02:27:05.657: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af" container "agnhost-container". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6172/pods/pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af/log?container=agnhost-container&previous=false": stream error: stream ID 167; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:27:05.657 Mar 24 02:27:05.662: INFO: Unexpected error: <*fmt.wrapError | 0xc000b736e0>: failed to get logs from pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6172/pods/pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af/log?container=agnhost-container&previous=false": stream error: stream ID 167; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af for agnhost-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-6172/pods/pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af/log?container=agnhost-container&previous=false\": stream error: stream ID 167; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc00109d920>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-6172/pods/pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 167, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af for agnhost-container: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-6172/pods/pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af/log?container=agnhost-container&previous=false": stream error: stream ID 167; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:27:05.662 < Exit [It] should be consumable from pods in volume with mappings as non-root [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:109 @ 03/24/23 02:27:05.662 (4.035s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:05.662 Mar 24 02:27:05.662: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:27:05.664 (1ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:05.664 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:27:05.664 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:27:05.664 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:05.664 STEP: Collecting events from namespace "configmap-6172". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:27:05.664 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:27:05.665 Mar 24 02:27:05.665: INFO: At 2023-03-24 02:27:03 +0000 UTC - event for pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:27:05.665: INFO: At 2023-03-24 02:27:03 +0000 UTC - event for pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:27:05.665: INFO: At 2023-03-24 02:27:03 +0000 UTC - event for pod-configmaps-73731642-d984-456d-8f4f-450c8259d2af: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:27:05.666: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:27:05.666: INFO: Mar 24 02:27:05.667: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:05.669: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:27:05.669: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:05.670: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:27:05.675: INFO: pod-c3b0be27-3ca7-4e36-846d-0017f3e8d698 started at 2023-03-24 02:27:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Container test-container ready: false, restart count 0 Mar 24 02:27:05.675: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Container back-off ready: false, restart count 1 Mar 24 02:27:05.675: INFO: pod-init-ada877c6-8b63-4d79-ade0-56ee2c9018dc started at 2023-03-24 02:26:45 +0000 UTC (2+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Init container init1 ready: false, restart count 2 Mar 24 02:27:05.675: INFO: Init container init2 ready: false, restart count 0 Mar 24 02:27:05.675: INFO: Container run1 ready: false, restart count 0 Mar 24 02:27:05.675: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:27:05.675: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Container client-container ready: true, restart count 0 Mar 24 02:27:05.675: INFO: isolated-pid-ns-test-pod started at 2023-03-24 02:26:45 +0000 UTC (0+2 container statuses recorded) Mar 24 02:27:05.675: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 02:27:05.675: INFO: Container test-container-2 ready: true, restart count 0 Mar 24 02:27:05.675: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:27:05.675: INFO: busybox-user-0-890068fd-3160-4dac-bc52-91f17162a427 started at 2023-03-24 02:26:57 +0000 UTC (0+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Container busybox-user-0-890068fd-3160-4dac-bc52-91f17162a427 ready: false, restart count 0 Mar 24 02:27:05.675: INFO: initcontainer-test-pod-with-post-start started at 2023-03-24 02:26:54 +0000 UTC (1+1 container statuses recorded) Mar 24 02:27:05.675: INFO: Init container init-1 ready: true, restart count 0 Mar 24 02:27:05.675: INFO: Container regular-1 ready: false, restart count 0 W0324 02:27:05.676101 1189 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:27:07.069: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:27:07.069 (1.405s) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:27:07.069 (1.405s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:27:07.069 STEP: Destroying namespace "configmap-6172" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:27:07.069 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:27:07.075 (6ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\sshould\sbe\sconsumable\sin\smultiple\svolumes\sin\sthe\ssame\spod\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362 for configmap-volume-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3161/pods/pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362/log?container=configmap-volume-test&previous=false": stream error: stream ID 65; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:52.095from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:26:46.011 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:26:46.011 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:26:46.011 Mar 24 02:26:46.020: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:26:46.02 (9ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:46.02 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:26:46.02 (0s) > Enter [It] should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:423 @ 03/24/23 02:26:46.02 STEP: Creating configMap with name configmap-test-volume-79404ca3-8b8e-4e47-969f-c18bf23927eb - test/e2e/common/storage/configmap_volume.go:433 @ 03/24/23 02:26:46.02 STEP: Creating a pod to test consume configMaps - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:26:46.027 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:26:52.084 Mar 24 02:26:52.085: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362 container configmap-volume-test: <nil> Mar 24 02:26:52.088: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362" container "configmap-volume-test". Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3161/pods/pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362/log?container=configmap-volume-test&previous=false": stream error: stream ID 65; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:26:52.088 Mar 24 02:26:52.095: INFO: Unexpected error: <*fmt.wrapError | 0xc000372f60>: failed to get logs from pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362 for configmap-volume-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3161/pods/pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362/log?container=configmap-volume-test&previous=false": stream error: stream ID 65; INTERNAL_ERROR; received from peer { msg: "failed to get logs from pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362 for configmap-volume-test: Get \"https://127.0.0.1:6443/api/v1/namespaces/configmap-3161/pods/pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362/log?container=configmap-volume-test&previous=false\": stream error: stream ID 65; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000aec120>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-3161/pods/pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362/log?container=configmap-volume-test&previous=false", Err: <http2.StreamError>{ StreamID: 65, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362 for configmap-volume-test: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-3161/pods/pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362/log?container=configmap-volume-test&previous=false": stream error: stream ID 65; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:26:52.095 < Exit [It] should be consumable in multiple volumes in the same pod [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:423 @ 03/24/23 02:26:52.095 (6.075s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:52.095 Mar 24 02:26:52.095: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:26:52.097 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:52.097 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:26:52.097 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:26:52.097 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:52.097 STEP: Collecting events from namespace "configmap-3161". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:26:52.097 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:26:52.1 Mar 24 02:26:52.100: INFO: At 2023-03-24 02:26:49 +0000 UTC - event for pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:26:52.100: INFO: At 2023-03-24 02:26:49 +0000 UTC - event for pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container configmap-volume-test Mar 24 02:26:52.100: INFO: At 2023-03-24 02:26:49 +0000 UTC - event for pod-configmaps-52f35275-fa3e-4c78-8644-5ad7160b2362: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container configmap-volume-test Mar 24 02:26:52.101: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:26:52.101: INFO: Mar 24 02:26:52.103: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:52.105: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 86 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:29 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:29 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:26:52.105: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:52.108: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:26:52.112: INFO: annotationupdate0afb0cdb-7029-465c-9a1f-d26130138a58 started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Container client-container ready: true, restart count 0 Mar 24 02:26:52.112: INFO: pod-hostip-6fd5cd29-9069-4e48-88e0-1e449a4d3a20 started at 2023-03-24 02:26:48 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Container test ready: true, restart count 0 Mar 24 02:26:52.112: INFO: alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 started at 2023-03-24 02:26:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Container alpine-nnp-false-3b5844f7-7b44-4204-8ce6-f89162f7a241 ready: false, restart count 0 Mar 24 02:26:52.112: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Container back-off ready: true, restart count 1 Mar 24 02:26:52.112: INFO: pod-init-ada877c6-8b63-4d79-ade0-56ee2c9018dc started at 2023-03-24 02:26:45 +0000 UTC (2+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Init container init1 ready: false, restart count 1 Mar 24 02:26:52.112: INFO: Init container init2 ready: false, restart count 0 Mar 24 02:26:52.112: INFO: Container run1 ready: false, restart count 0 Mar 24 02:26:52.112: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Container image-pull-test ready: false, restart count 0 Mar 24 02:26:52.112: INFO: downward-api-93d5bbb7-c03b-4cb7-a443-54e7805634f1 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Container dapi-container ready: false, restart count 0 Mar 24 02:26:52.112: INFO: isolated-pid-ns-test-pod started at 2023-03-24 02:26:45 +0000 UTC (0+2 container statuses recorded) Mar 24 02:26:52.112: INFO: Container test-container-1 ready: true, restart count 0 Mar 24 02:26:52.112: INFO: Container test-container-2 ready: true, restart count 0 Mar 24 02:26:52.112: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:26:52.112: INFO: Container agnhost-container ready: true, restart count 0 W0324 02:26:52.113485 1159 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:26:54.420: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:26:54.42 (2.323s) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:26:54.42 (2.323s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:26:54.42 STEP: Destroying namespace "configmap-3161" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:26:54.42 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:26:54.426 (6ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sConfigMap\supdates\sshould\sbe\sreflected\sin\svolume\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] Timed out after 240.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc00194f290>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-670/pods/pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1/log?container=agnhost-container&previous=false": stream error: stream ID 1883; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-670/pods/pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1883, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:158 @ 03/24/23 02:41:04.562from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:37:02.529 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:37:02.529 STEP: Building a namespace api object, basename configmap - test/e2e/framework/framework.go:250 @ 03/24/23 02:37:02.529 Mar 24 02:37:02.533: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] ConfigMap - set up framework | framework.go:191 @ 03/24/23 02:37:02.533 (4ms) > Enter [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:02.533 < Exit [BeforeEach] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:37:02.533 (0s) > Enter [It] updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:124 @ 03/24/23 02:37:02.533 Mar 24 02:37:02.534: INFO: Couldn't get node TTL annotation (using default value of 0): No TTL annotation found on the node STEP: Creating configMap with name configmap-test-upd-b29b7c73-2c77-45d5-a333-51a1f7892d1f - test/e2e/common/storage/configmap_volume.go:142 @ 03/24/23 02:37:02.534 STEP: Creating the pod - test/e2e/common/storage/configmap_volume.go:151 @ 03/24/23 02:37:02.536 [FAILED] Timed out after 240.000s. The function passed to Eventually returned the following error: <*url.Error | 0xc00194f290>: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-670/pods/pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1/log?container=agnhost-container&previous=false": stream error: stream ID 1883; INTERNAL_ERROR; received from peer { Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/configmap-670/pods/pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1/log?container=agnhost-container&previous=false", Err: <http2.StreamError>{ StreamID: 1883, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, } In [It] at: test/e2e/common/storage/configmap_volume.go:158 @ 03/24/23 02:41:04.562 < Exit [It] updates should be reflected in volume [NodeConformance] [Conformance] - test/e2e/common/storage/configmap_volume.go:124 @ 03/24/23 02:41:04.562 (4m2.029s) > Enter [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:41:04.562 Mar 24 02:41:04.562: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] ConfigMap - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:41:04.564 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:41:04.564 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:41:04.564 (0s) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:41:04.564 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:41:04.564 STEP: Collecting events from namespace "configmap-670". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:41:04.564 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:41:04.566 Mar 24 02:41:04.566: INFO: At 2023-03-24 02:37:03 +0000 UTC - event for pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:41:04.566: INFO: At 2023-03-24 02:37:03 +0000 UTC - event for pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container agnhost-container Mar 24 02:41:04.566: INFO: At 2023-03-24 02:37:03 +0000 UTC - event for pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container agnhost-container Mar 24 02:41:04.567: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:41:04.567: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:02 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:41:04 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:41:04 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-24 02:37:02 +0000 UTC }] Mar 24 02:41:04.567: INFO: Mar 24 02:41:04.569: INFO: Unable to fetch configmap-670/pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1/agnhost-container logs: Get "https://127.0.0.1:6443/api/v1/namespaces/configmap-670/pods/pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1/log?container=agnhost-container&previous=false&tailLines=42": stream error: stream ID 1891; INTERNAL_ERROR; received from peer Mar 24 02:41:04.571: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:41:04.572: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 4021 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:37:12 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:37:12 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:41:04.572: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:41:04.573: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:41:04.576: INFO: pod-secrets-99839566-1013-4656-8f10-e3c4aed159fb started at 2023-03-24 02:38:16 +0000 UTC (0+3 container statuses recorded) Mar 24 02:41:04.576: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:41:04.576: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:41:04.576: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:41:04.576: INFO: pod-configmaps-9742e121-5b79-40ad-8535-1d6d6df9b5e1 started at 2023-03-24 02:37:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:41:04.576: INFO: Container agnhost-container ready: false, restart count 0 Mar 24 02:41:04.576: INFO: busybox-080adf01-5dd2-4eab-b0af-0ae92a626b92 started at 2023-03-24 02:37:53 +0000 UTC (0+1 container statuses recorded) Mar 24 02:41:04.576: INFO: Container busybox ready: true, restart count 0 Mar 24 02:41:04.576: INFO: back-off-cap started at 2023-03-24 02:38:48 +0000 UTC (0+1 container statuses recorded) Mar 24 02:41:04.576: INFO: Container back-off-cap ready: false, restart count 4 W0324 02:41:04.577443 1169 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:41:04.615: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:41:04.615 (51ms) < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - dump namespaces | framework.go:209 @ 03/24/23 02:41:04.615 (51ms) > Enter [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:41:04.615 STEP: Destroying namespace "configmap-670" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:41:04.615 < Exit [DeferCleanup (Each)] [sig-storage] ConfigMap - tear down framework | framework.go:206 @ 03/24/23 02:41:04.618 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\scpu\slimit\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-1450/pods/downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55/log?container=client-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:23.903from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:36:19.862 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:36:19.862 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:36:19.862 Mar 24 02:36:19.866: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:36:19.866 (4ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:19.866 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:36:19.866 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:36:19.866 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:36:19.866 (0s) > Enter [It] should provide container's cpu limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:194 @ 03/24/23 02:36:19.866 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:36:19.866 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:36:23.893 Mar 24 02:36:23.895: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55 container client-container: <nil> Mar 24 02:36:23.897: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-1450/pods/downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55/log?container=client-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:36:23.897 Mar 24 02:36:23.903: INFO: Unexpected error: <*fmt.wrapError | 0xc000e4e220>: failed to get logs from downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-1450/pods/downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55/log?container=client-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55 for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-1450/pods/downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55/log?container=client-container&previous=false\": stream error: stream ID 1215; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000fe9aa0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-1450/pods/downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 1215, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-1450/pods/downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55/log?container=client-container&previous=false": stream error: stream ID 1215; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:36:23.903 < Exit [It] should provide container's cpu limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:194 @ 03/24/23 02:36:23.903 (4.037s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:23.903 Mar 24 02:36:23.903: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:36:23.905 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:23.905 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:36:23.905 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 02:36:23.905 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:23.905 STEP: Collecting events from namespace "downward-api-1450". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:36:23.905 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:36:23.906 Mar 24 02:36:23.906: INFO: At 2023-03-24 02:36:21 +0000 UTC - event for downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:36:23.906: INFO: At 2023-03-24 02:36:21 +0000 UTC - event for downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 02:36:23.906: INFO: At 2023-03-24 02:36:21 +0000 UTC - event for downwardapi-volume-e8398e23-ed07-47d4-8b08-f03514f2ea55: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 02:36:23.907: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:36:23.907: INFO: Mar 24 02:36:23.909: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:23.910: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:36:23.910: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:23.911: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:36:23.915: INFO: hostfqdn-208890 started at 2023-03-24 02:36:20 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:23.915: INFO: Container test-container ready: false, restart count 0 Mar 24 02:36:23.915: INFO: stats-busybox-1 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:23.915: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:23.915: INFO: liveness-91a95c0c-b9dc-433a-8431-013fa27adec2 started at 2023-03-24 02:35:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:23.915: INFO: Container agnhost-container ready: true, restart count 2 Mar 24 02:36:23.915: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:36:23.915: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:36:23.915: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:36:23.915: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:36:23.915: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:23.915: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:36:23.915: INFO: test-grpc-14325337-e693-4623-ab07-9f8d0ff3be09 started at 2023-03-24 02:35:54 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:23.915: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:36:23.915: INFO: stats-busybox-0 started at 2023-03-24 02:35:32 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:23.915: INFO: Container busybox-container ready: true, restart count 1 Mar 24 02:36:23.915: INFO: busybox-770178eb-3a40-4ab9-8b9f-3e9983310254 started at 2023-03-24 02:36:10 +0000 UTC (0+1 container statuses recorded) Mar 24 02:36:23.915: INFO: Container busybox ready: true, restart count 0 W0324 02:36:23.916749 1175 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:36:25.122: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:36:25.122 (1.217s) < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 02:36:25.122 (1.217s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 02:36:25.122 STEP: Destroying namespace "downward-api-1450" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:36:25.122 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 02:36:25.132 (10ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\scpu\srequest\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-2482/pods/downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208/log?container=client-container&previous=false": stream error: stream ID 371; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:30:39.03from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:30:34.993 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:30:34.993 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:30:34.993 Mar 24 02:30:34.996: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:30:34.996 (3ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:34.996 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:30:34.996 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:30:34.996 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:30:34.996 (0s) > Enter [It] should provide container's cpu request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:222 @ 03/24/23 02:30:34.996 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:30:34.996 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:30:39.021 Mar 24 02:30:39.023: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208 container client-container: <nil> Mar 24 02:30:39.024: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-2482/pods/downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208/log?container=client-container&previous=false": stream error: stream ID 371; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:30:39.024 Mar 24 02:30:39.030: INFO: Unexpected error: <*fmt.wrapError | 0xc0011c1ae0>: failed to get logs from downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-2482/pods/downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208/log?container=client-container&previous=false": stream error: stream ID 371; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208 for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-2482/pods/downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208/log?container=client-container&previous=false\": stream error: stream ID 371; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000ad3800>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-2482/pods/downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 371, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-2482/pods/downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208/log?container=client-container&previous=false": stream error: stream ID 371; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:30:39.03 < Exit [It] should provide container's cpu request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:222 @ 03/24/23 02:30:39.03 (4.034s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:30:39.03 Mar 24 02:30:39.030: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:30:39.032 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:30:39.032 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:30:39.032 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 02:30:39.032 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:30:39.032 STEP: Collecting events from namespace "downward-api-2482". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:30:39.032 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:30:39.033 Mar 24 02:30:39.033: INFO: At 2023-03-24 02:30:35 +0000 UTC - event for downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:30:39.033: INFO: At 2023-03-24 02:30:35 +0000 UTC - event for downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 02:30:39.033: INFO: At 2023-03-24 02:30:35 +0000 UTC - event for downwardapi-volume-04d988aa-290e-44ea-a764-9d4053d59208: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 02:30:39.034: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:30:39.034: INFO: Mar 24 02:30:39.036: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:39.037: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:26:59 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:26:59 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:30:39.037: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:39.038: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:30:39.042: INFO: test-webserver-769389c2-9f17-40bd-9192-11dd8e99931e started at 2023-03-24 02:27:42 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:39.042: INFO: Container test-webserver ready: true, restart count 0 Mar 24 02:30:39.042: INFO: test-grpc-5b5a6ecf-c398-4149-bd27-6dbe401bfb2e started at 2023-03-24 02:28:18 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:39.042: INFO: Container agnhost ready: true, restart count 0 Mar 24 02:30:39.042: INFO: liveness-9969294c-fb4c-4495-ae1c-f746a73c87b5 started at 2023-03-24 02:26:45 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:39.042: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:30:39.042: INFO: pod-configmaps-0ec08cc6-b90e-4523-8c87-6b6a7ed7b62c started at 2023-03-24 02:30:31 +0000 UTC (0+2 container statuses recorded) Mar 24 02:30:39.042: INFO: Container agnhost-container ready: true, restart count 0 Mar 24 02:30:39.042: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 24 02:30:39.042: INFO: pod-projected-secrets-40cbaf5b-ae1e-4a03-9007-b24ba46de9fc started at 2023-03-24 02:30:00 +0000 UTC (0+3 container statuses recorded) Mar 24 02:30:39.042: INFO: Container creates-volume-test ready: true, restart count 0 Mar 24 02:30:39.042: INFO: Container dels-volume-test ready: true, restart count 0 Mar 24 02:30:39.042: INFO: Container upds-volume-test ready: true, restart count 0 Mar 24 02:30:39.042: INFO: pod-back-off-image started at 2023-03-24 02:26:29 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:39.042: INFO: Container back-off ready: true, restart count 7 Mar 24 02:30:39.042: INFO: pod-configmaps-15395c60-09f4-4352-837e-ffe4d1590400 started at 2023-03-24 02:27:48 +0000 UTC (0+3 container statuses recorded) Mar 24 02:30:39.042: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:30:39.042: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:30:39.042: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:30:39.042: INFO: image-pull-testc9af1383-602c-4904-a6af-f2b6fbd81315 started at 2023-03-24 02:26:51 +0000 UTC (0+1 container statuses recorded) Mar 24 02:30:39.042: INFO: Container image-pull-test ready: false, restart count 0 W0324 02:30:39.043881 1172 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:30:39.134: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:30:39.134 (102ms) < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 02:30:39.134 (102ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 02:30:39.134 STEP: Destroying namespace "downward-api-2482" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:30:39.134 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 02:30:39.136 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\smemory\slimit\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6634/pods/downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4/log?container=client-container&previous=false": stream error: stream ID 1153; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:13.443from junit_cos-stable01.xml
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:35:09.32 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:35:09.32 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:35:09.321 Mar 24 02:35:09.343: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:35:09.343 (23ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:09.343 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:35:09.343 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:35:09.343 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:35:09.343 (0s) > Enter [It] should provide container's memory limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:208 @ 03/24/23 02:35:09.343 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:35:09.343 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:35:13.401 Mar 24 02:35:13.404: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4 container client-container: <nil> Mar 24 02:35:13.410: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6634/pods/downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4/log?container=client-container&previous=false": stream error: stream ID 1153; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:35:13.41 Mar 24 02:35:13.443: INFO: Unexpected error: <*fmt.wrapError | 0xc000b2aea0>: failed to get logs from downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6634/pods/downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4/log?container=client-container&previous=false": stream error: stream ID 1153; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4 for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-6634/pods/downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4/log?container=client-container&previous=false\": stream error: stream ID 1153; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc000de90b0>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6634/pods/downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 1153, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4 for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-6634/pods/downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4/log?container=client-container&previous=false": stream error: stream ID 1153; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:35:13.443 < Exit [It] should provide container's memory limit [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:208 @ 03/24/23 02:35:13.443 (4.1s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:13.443 Mar 24 02:35:13.443: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:35:13.448 (5ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:13.448 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:35:13.448 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 02:35:13.448 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:13.448 STEP: Collecting events from namespace "downward-api-6634". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:35:13.448 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:35:13.454 Mar 24 02:35:13.454: INFO: At 2023-03-24 02:35:11 +0000 UTC - event for downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:35:13.454: INFO: At 2023-03-24 02:35:11 +0000 UTC - event for downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 02:35:13.454: INFO: At 2023-03-24 02:35:11 +0000 UTC - event for downwardapi-volume-ea7a80b8-bd48-4ab8-a0ed-eeccab9b21c4: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 02:35:13.455: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:35:13.455: INFO: Mar 24 02:35:13.462: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:13.465: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 2042 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-03-24 02:32:06 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:,DoNotUseExternalID:,ProviderID:,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[],},Status:NodeStatus{Capacity:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3855532032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3593388032 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:28 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-24 02:32:06 +0000 UTC,LastTransitionTime:2023-03-24 02:26:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.101,},NodeAddress{Type:Hostname,Address:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:669d9363d885fa7ceead90a73e377097,SystemUUID:669d9363-d885-fa7c-eead-90a73e377097,BootID:aeaffcbc-afd0-4a2f-b33c-bd0bf84826dd,KernelVersion:5.15.89+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-44-g584d13d5c,KubeletVersion:v1.28.0-alpha.0.1+f33498a8256b45,KubeProxyVersion:v1.28.0-alpha.0.1+f33498a8256b45,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/perl@sha256:c613344cdd31c5055961b078f831ef9d9199fc9111efe6e81bea3f00d78bd979 registry.k8s.io/e2e-test-images/perl:5.26],SizeBytes:325397679,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep@sha256:91ab3b5ee22441c99370944e2e2cb32670db62db433611b4e3780bdee6a8e5a1 registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep:1.3],SizeBytes:213443508,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/gluster@sha256:033a12fe65438751690b519cebd4135a3485771086bcf437212b7b886bb7956c registry.k8s.io/e2e-test-images/volume/gluster:1.3],SizeBytes:115217395,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/node-problem-detector/node-problem-detector@sha256:0ce71ef6d759425d22b10e65b439749fe5d13377a188e2fc060b731cdb4e6901 registry.k8s.io/node-problem-detector/node-problem-detector:v0.8.7],SizeBytes:47786458,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-is@sha256:8285539c79625b192a5e33fc3d21edc1a7776fb9afe15fae3b5037a7a8020839 registry.k8s.io/e2e-test-images/node-perf/npb-is:1.2],SizeBytes:39706325,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/node-perf/npb-ep@sha256:90b5cfc5451428aad4dd6af9960640f2506804d35aa05e83c11bf0a46ac318c8 registry.k8s.io/e2e-test-images/node-perf/npb-ep:1.2],SizeBytes:39705373,},ContainerImage{Names:[gcr.io/cadvisor/cadvisor@sha256:89e6137f068ded2e9a3a012ce71260b9afc57a19305842aa1074239841a539a7 gcr.io/cadvisor/cadvisor:v0.43.0],SizeBytes:31056802,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[docker.io/nfvpe/sriov-device-plugin@sha256:518499ed631ff84b43153b8f7624c1aaacb75a721038857509fe690abdf62ddb docker.io/nfvpe/sriov-device-plugin:v3.1],SizeBytes:12638340,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-device-plugin@sha256:e84f6ca27c51ddedf812637dd2bcf771ad69fdca1173e5690c372370d0f93c40 registry.k8s.io/e2e-test-images/sample-device-plugin:1.3],SizeBytes:12410396,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/nvidia-gpu-device-plugin@sha256:4b036e8844920336fa48f36edeb7d4398f426d6a934ba022848deed2edbf09aa],SizeBytes:6819465,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/ipc-utils@sha256:647d092bada3b46c449d875adf31d71c1dd29c244e9cca6a04fddf9d6bcac136 registry.k8s.io/e2e-test-images/ipc-utils:1.3],SizeBytes:4013020,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/stress:v1],SizeBytes:1558004,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/busybox@sha256:4bdd623e848417d96127e16037743f0cd8b528c026e9175e22a84f639eca58ff],SizeBytes:676941,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 24 02:35:13.466: INFO: Logging kubelet events for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:13.471: INFO: Logging pods the kubelet thinks is on node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:35:13.483: INFO: pod-handle-http-request started at 2023-03-24 02:35:09 +0000 UTC (0+2 container statuses recorded) Mar 24 02:35:13.483: INFO: Container container-handle-http-request ready: false, restart count 0 Mar 24 02:35:13.483: INFO: Container container-handle-https-request ready: false, restart count 0 Mar 24 02:35:13.483: INFO: pod-secrets-f92ff363-80a5-4215-b894-d6c1a561bbf6 started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:13.483: INFO: Container secret-volume-test ready: false, restart count 0 Mar 24 02:35:13.483: INFO: pod-projected-configmaps-8595c0c5-592d-4316-9a2a-daf3e4764a8a started at 2023-03-24 02:34:12 +0000 UTC (0+3 container statuses recorded) Mar 24 02:35:13.483: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 24 02:35:13.483: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 24 02:35:13.483: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 24 02:35:13.483: INFO: image-pull-test38320400-6f0a-4df7-9ba3-fde3583ff12c started at 2023-03-24 02:31:39 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:13.483: INFO: Container image-pull-test ready: true, restart count 0 Mar 24 02:35:13.483: INFO: busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da started at 2023-03-24 02:34:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:13.483: INFO: Container busybox-readonly-fs3b1d8687-92cc-4c15-b553-a68e9dd598da ready: true, restart count 0 Mar 24 02:35:13.483: INFO: test-runtimeclass-runtimeclass-3147-preconfigured-handler-dzc6r started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:13.483: INFO: Container test ready: false, restart count 0 Mar 24 02:35:13.483: INFO: busybox-2ac35595-9ff3-4ea2-b8d3-ac4a8a906b18 started at 2023-03-24 02:35:09 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:13.483: INFO: Container busybox ready: false, restart count 0 Mar 24 02:35:13.483: INFO: static-pod-f3de9564-0369-4a2e-a776-2930fbc4275a-tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 started at 2023-03-24 02:35:02 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:13.483: INFO: Container test ready: false, restart count 0 Mar 24 02:35:13.483: INFO: labelsupdatec3c4f0a4-a2a3-4b51-b69a-7cb613f58620 started at 2023-03-24 02:32:15 +0000 UTC (0+1 container statuses recorded) Mar 24 02:35:13.483: INFO: Container client-container ready: false, restart count 0 W0324 02:35:13.485096 1158 metrics_grabber.go:111] Can't find any pods in namespace kube-system to grab metrics from Mar 24 02:35:16.527: INFO: Latency metrics for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:35:16.527 (3.079s) < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 02:35:16.527 (3.079s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 02:35:16.527 STEP: Destroying namespace "downward-api-6634" for this suite. - test/e2e/framework/framework.go:351 @ 03/24/23 02:35:16.527 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - tear down framework | framework.go:206 @ 03/24/23 02:35:16.53 (3ms)
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=E2eNode\sSuite\s\[It\]\s\[sig\-storage\]\sDownward\sAPI\svolume\sshould\sprovide\scontainer\'s\smemory\srequest\s\[NodeConformance\]\s\[Conformance\]$'
[FAILED] failed to get logs from downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9079/pods/downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee/log?container=client-container&previous=false": stream error: stream ID 323; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:29:17.863
> Enter [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:29:13.822 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:211 @ 03/24/23 02:29:13.822 STEP: Building a namespace api object, basename downward-api - test/e2e/framework/framework.go:250 @ 03/24/23 02:29:13.822 Mar 24 02:29:13.826: INFO: Skipping waiting for service account < Exit [BeforeEach] [sig-storage] Downward API volume - set up framework | framework.go:191 @ 03/24/23 02:29:13.826 (4ms) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:13.826 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:33 @ 03/24/23 02:29:13.826 (0s) > Enter [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:29:13.826 < Exit [BeforeEach] [sig-storage] Downward API volume - test/e2e/common/storage/downwardapi_volume.go:45 @ 03/24/23 02:29:13.826 (0s) > Enter [It] should provide container's memory request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:236 @ 03/24/23 02:29:13.826 STEP: Creating a pod to test downward API volume plugin - test/e2e/framework/pod/output/output.go:243 @ 03/24/23 02:29:13.826 STEP: Saw pod success - test/e2e/framework/pod/wait.go:409 @ 03/24/23 02:29:17.851 Mar 24 02:29:17.853: INFO: Trying to get logs from node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 pod downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee container client-container: <nil> Mar 24 02:29:17.855: INFO: Failed to get logs from node "tmp-node-e2e-b0791930-cos-stable-101-17162-127-42" pod "downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee" container "client-container". Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9079/pods/downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee/log?container=client-container&previous=false": stream error: stream ID 323; INTERNAL_ERROR; received from peer STEP: delete the pod - test/e2e/framework/pod/output/output.go:168 @ 03/24/23 02:29:17.855 Mar 24 02:29:17.863: INFO: Unexpected error: <*fmt.wrapError | 0xc0013bd2e0>: failed to get logs from downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9079/pods/downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee/log?container=client-container&previous=false": stream error: stream ID 323; INTERNAL_ERROR; received from peer { msg: "failed to get logs from downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee for client-container: Get \"https://127.0.0.1:6443/api/v1/namespaces/downward-api-9079/pods/downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee/log?container=client-container&previous=false\": stream error: stream ID 323; INTERNAL_ERROR; received from peer", err: <*url.Error | 0xc001408900>{ Op: "Get", URL: "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9079/pods/downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee/log?container=client-container&previous=false", Err: <http2.StreamError>{ StreamID: 323, Code: 2, Cause: <*errors.errorString | 0xc0000adbd0>{ s: "received from peer", }, }, }, } [FAILED] failed to get logs from downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee for client-container: Get "https://127.0.0.1:6443/api/v1/namespaces/downward-api-9079/pods/downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee/log?container=client-container&previous=false": stream error: stream ID 323; INTERNAL_ERROR; received from peer In [It] at: test/e2e/framework/pod/output/output.go:247 @ 03/24/23 02:29:17.863 < Exit [It] should provide container's memory request [NodeConformance] [Conformance] - test/e2e/common/storage/downwardapi_volume.go:236 @ 03/24/23 02:29:17.863 (4.037s) > Enter [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:17.863 Mar 24 02:29:17.863: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-storage] Downward API volume - test/e2e/framework/node/init/init.go:33 @ 03/24/23 02:29:17.865 (2ms) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:17.865 < Exit [DeferCleanup (Each)] [sig-storage] Downward API volume - test/e2e/framework/metrics/init/init.go:35 @ 03/24/23 02:29:17.865 (0s) > Enter [DeferCleanup (Each)] [sig-storage] Downward API volume - dump namespaces | framework.go:209 @ 03/24/23 02:29:17.865 STEP: dump namespace information after failure - test/e2e/framework/framework.go:288 @ 03/24/23 02:29:17.865 STEP: Collecting events from namespace "downward-api-9079". - test/e2e/framework/debug/dump.go:42 @ 03/24/23 02:29:17.865 STEP: Found 3 events. - test/e2e/framework/debug/dump.go:46 @ 03/24/23 02:29:17.867 Mar 24 02:29:17.867: INFO: At 2023-03-24 02:29:14 +0000 UTC - event for downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Mar 24 02:29:17.867: INFO: At 2023-03-24 02:29:14 +0000 UTC - event for downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Created: Created container client-container Mar 24 02:29:17.867: INFO: At 2023-03-24 02:29:14 +0000 UTC - event for downwardapi-volume-ded659e9-c025-40bc-9463-4e9d6226a9ee: {kubelet tmp-node-e2e-b0791930-cos-stable-101-17162-127-42} Started: Started container client-container Mar 24 02:29:17.869: INFO: POD NODE PHASE GRACE CONDITIONS Mar 24 02:29:17.869: INFO: Mar 24 02:29:17.871: INFO: Logging node info for node tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 Mar 24 02:29:17.873: INFO: Node Info: &Node{ObjectMeta:{tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 c9b2361c-53fd-45bb-a634-f61edbf43a32 408 0 2023-03-24 02:26:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/os:linux kubernetes.io/arch:amd64 kubernetes.io/hostname:tmp-node-e2e-b0791930-cos-stable-101-17162-127-42 kubernetes.io/os:linux] map[volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-24 02:26:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch