Recent runs || View in Spyglass
PR | thockin: Don't call service Validate / Prepare hooks twice |
Result | FAILURE |
Tests | 14 failed / 779 succeeded |
Started | |
Elapsed | 52m22s |
Revision | |
Builder | 2b596850-1633-11eb-be4a-ded04c9187e3 |
Refs |
master:5935fcd7 95666:4feece2e |
infra-commit | d88010efd |
job-version | v1.20.0-alpha.3.133+7bcfce373503ce |
master_os_image | ubuntu-2004-focal-v20200423 |
node_os_image | ubuntu-2004-focal-v20200423 |
repo | k8s.io/kubernetes |
repo-commit | 7bcfce373503ce22130cdd7524343396998720dc |
repos | {u'k8s.io/kubernetes': u'master:5935fcd704fe89048776d02cf1ef4f939743c042,95666:4feece2e817b9474584c1548b3531d6dd30fd8ea', u'k8s.io/release': u'master'} |
revision | v1.20.0-alpha.3.133+7bcfce373503ce |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sShould\srecreate\sevicted\sstatefulset\s\[Conformance\]$'
test/e2e/apps/statefulset.go:103 Oct 24 20:26:27.242: Unexpected error: <*errors.StatusError | 0xc0027c7d60>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_25.xml
{"msg":"PASSED [sig-storage] CSI mock volume CSI Volume expansion should expand volume by restarting pod if attach=off, nodeExpansion=on","total":-1,"completed":17,"skipped":77,"failed":0} [BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:26:26.481: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-3529 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-3529 Oct 24 20:26:27.241: FAIL: Unexpected error: <*errors.StatusError | 0xc0027c7d60>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002468a80) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002468a80) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002468a80, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:26:27.316: INFO: Deleting all statefulset in ns statefulset-3529 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-3529". �[1mSTEP�[0m: Found 0 events. Oct 24 20:26:27.637: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:26:27.637: INFO: Oct 24 20:26:27.709: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:26:27.777: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 21291 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:27.778: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:26:27.839: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:26:27.945: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:27.945: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:26:27.945: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:27.945: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:26:27.945: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:27.945: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:26:27.945: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:27.945: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:27.945: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:26:27.945: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:27.945: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:26:27.945: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:27.945: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:26:27.945: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:27.945: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:26:27.945: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:27.945: INFO: Container etcd-container ready: true, restart count 0 W1024 20:26:28.050764 16756 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:28.398: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:26:28.398: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:28.466: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 24116 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4306":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-5994":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-5360":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-261":"csi-mock-csi-mock-volumes-261","csi-mock-csi-mock-volumes-7525":"csi-mock-csi-mock-volumes-7525","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kubelet Update v1 2020-10-24 20:24:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:24:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:28.466: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:28.535: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:28.720: INFO: all-succeed-xctxr started at 2020-10-24 20:26:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container c ready: false, restart count 0 Oct 24 20:26:28.720: INFO: gluster-server started at 2020-10-24 20:26:23 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:26:28.720: INFO: fail-once-non-local-qg5lr started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container c ready: false, restart count 0 Oct 24 20:26:28.720: INFO: local-injector started at 2020-10-24 20:26:19 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container local-injector ready: false, restart count 0 Oct 24 20:26:28.720: INFO: fail-once-non-local-qpnx5 started at 2020-10-24 20:26:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container c ready: false, restart count 0 Oct 24 20:26:28.720: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-rn79t started at 2020-10-24 20:26:18 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:26:28.720: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:28.720: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:28.720: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:26:28.720: INFO: fail-once-non-local-kz9px started at 2020-10-24 20:26:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container c ready: false, restart count 0 Oct 24 20:26:28.720: INFO: downwardapi-volume-c088ca51-5860-49d7-8e03-f075b8bab8ea started at 2020-10-24 20:26:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container client-container ready: false, restart count 0 Oct 24 20:26:28.720: INFO: netserver-0 started at 2020-10-24 20:26:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container webserver ready: false, restart count 0 Oct 24 20:26:28.720: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:26:28.720: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:24:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:26:28.720: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:26:28.720: INFO: fail-once-non-local-vhgpd started at 2020-10-24 20:26:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container c ready: false, restart count 0 Oct 24 20:26:28.720: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:26:28.720: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-kwcbx started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:26:28.720: INFO: fail-once-non-local-8jhht started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container c ready: false, restart count 0 Oct 24 20:26:28.720: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:28 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:28.720: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:26:28.720: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:26:28.720: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:26:28.720: INFO: metadata-volume-48280d87-9f25-40ac-b71a-3af08290aea8 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:28.720: INFO: nfs-client started at <nil> (0+0 container statuses recorded) Oct 24 20:26:28.720: INFO: affinity-clusterip-transition-52xfd started at 2020-10-24 20:26:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Oct 24 20:26:28.720: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:28.720: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:26:28.720: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:26:28.720: INFO: all-succeed-dns9d started at <nil> (0+0 container statuses recorded) Oct 24 20:26:28.720: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:26:28.720: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container coredns ready: true, restart count 0 Oct 24 20:26:28.720: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:28.720: INFO: Container csi-snapshotter ready: true, restart count 0 W1024 20:26:28.879670 16756 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:29.659: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:29.659: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:29.771: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 29038 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-volume-expand-199":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-1202":"csi-mock-csi-mock-volumes-1202","csi-mock-csi-mock-volumes-167":"csi-mock-csi-mock-volumes-167","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-9175":"csi-mock-csi-mock-volumes-9175","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:26:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:io.kubernetes.storage.mock/node":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:26:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1202^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1202^4,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:29.772: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:29.920: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:30.127: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:26:30.128: INFO: affinity-clusterip-transition-9vvcg started at 2020-10-24 20:26:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Oct 24 20:26:30.128: INFO: pvc-volume-tester-72tdl started at 2020-10-24 20:26:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container volume-tester ready: true, restart count 0 Oct 24 20:26:30.128: INFO: netserver-1 started at 2020-10-24 20:26:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container webserver ready: false, restart count 0 Oct 24 20:26:30.128: INFO: all-succeed-g8vg2 started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container c ready: false, restart count 0 Oct 24 20:26:30.128: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:25:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:26:30.128: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:26:30.128: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container coredns ready: true, restart count 0 Oct 24 20:26:30.128: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:30.128: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:30.128: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:26:30.128: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:26:30.128: INFO: csi-mockplugin-0 started at 2020-10-24 20:25:57 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:30.128: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:26:30.128: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:26:30.128: INFO: Container mock ready: true, restart count 0 Oct 24 20:26:30.128: INFO: busybox-2909d4f8-e859-4c4d-bfb0-40d3844685ba started at 2020-10-24 20:24:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container busybox ready: true, restart count 0 Oct 24 20:26:30.128: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:26:30.128: INFO: liveness-da84de3e-0a18-4838-95dd-25b912f87d16 started at 2020-10-24 20:25:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container liveness ready: true, restart count 4 Oct 24 20:26:30.128: INFO: all-succeed-bn8lx started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container c ready: false, restart count 0 Oct 24 20:26:30.128: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:26:07 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:30.128: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:26:30.128: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:26:30.128: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:26:30.128: INFO: execpod-affinitysscmt started at 2020-10-24 20:26:12 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:26:30.128: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:26:30.128: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-mrthr started at 2020-10-24 20:26:21 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:26:30.128: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:25:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:26:30.128: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:26:10 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:30.128: INFO: Container csi-attacher ready: true, restart count 0 W1024 20:26:30.283885 16756 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:30.870: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:30.870: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:30.955: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 29400 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-6603":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-7825":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-701":"csi-mock-csi-mock-volumes-701","csi-mock-csi-mock-volumes-8880":"csi-mock-csi-mock-volumes-8880","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:25:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2020-10-24 20:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:30 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:30 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:30 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:26:30 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-7825^3075b8c5-1637-11eb-8b15-9a1b4ff97d00],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-7825^3075b8c5-1637-11eb-8b15-9a1b4ff97d00,DevicePath:,},AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-6e6f84b4-9eaf-4bb3-af44-32218242f6cd,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-6e6f84b4-9eaf-4bb3-af44-32218242f6cd,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:30.956: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:31.037: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:31.199: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:31.199: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:31.199: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:26:31.199: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.199: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:26:31.199: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:26:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.199: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:26:31.199: INFO: csi-mockplugin-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.199: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.199: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:26:31.199: INFO: pvc-volume-tester-qj54c started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: pod-service-account-nomountsa-nomountspec started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:26:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:26:31.200: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:26:31.200: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:26:31.200: INFO: gcepd-injector started at 2020-10-24 20:25:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container gcepd-injector ready: true, restart count 0 Oct 24 20:26:31.200: INFO: pod-0 started at 2020-10-24 20:25:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container donothing ready: false, restart count 0 Oct 24 20:26:31.200: INFO: csi-hostpath-provisioner-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: success started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container success ready: false, restart count 0 Oct 24 20:26:31.200: INFO: csi-mockplugin-resizer-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: webhook-to-be-mutated started at 2020-10-24 20:26:00 +0000 UTC (1+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Init container webhook-added-init-container ready: false, restart count 0 Oct 24 20:26:31.200: INFO: Container example ready: false, restart count 0 Oct 24 20:26:31.200: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:26:31.200: INFO: pod-service-account-defaultsa started at 2020-10-24 20:26:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: false, restart count 0 Oct 24 20:26:31.200: INFO: pod-subpath-test-dynamicpv-g4pp started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: pod-service-account-mountsa-mountspec started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: csi-mockplugin-0 started at 2020-10-24 20:26:15 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:31.200: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:26:31.200: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:26:31.200: INFO: Container mock ready: true, restart count 0 Oct 24 20:26:31.200: INFO: pod-service-account-nomountsa-mountspec started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: httpd started at 2020-10-24 20:25:47 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:31.200: INFO: csi-hostpath-resizer-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: pod-service-account-mountsa started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: pod-service-account-defaultsa-mountspec started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: pod-service-account-mountsa-nomountspec started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: pod-subpath-test-inlinevolume-pr8q started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: labelsupdate8f8854b1-0bdf-4451-b060-745ce24df25d started at 2020-10-24 20:25:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container client-container ready: false, restart count 0 Oct 24 20:26:31.200: INFO: pod-with-prestop-http-hook started at 2020-10-24 20:25:43 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container pod-with-prestop-http-hook ready: false, restart count 0 Oct 24 20:26:31.200: INFO: pod-service-account-nomountsa started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:26:31.200: INFO: pod-handle-http-request started at 2020-10-24 20:25:32 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:26:31.200: INFO: affinity-clusterip-transition-gsrqc started at 2020-10-24 20:26:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Oct 24 20:26:31.200: INFO: update-demo-nautilus-qjr69 started at 2020-10-24 20:25:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container update-demo ready: false, restart count 0 Oct 24 20:26:31.200: INFO: pod-service-account-defaultsa-nomountspec started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:31.200: INFO: nfs-server started at 2020-10-24 20:26:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:31.200: INFO: Container nfs-server ready: true, restart count 0 Oct 24 20:26:31.200: INFO: csi-hostpath-snapshotter-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:31.200: INFO: csi-mockplugin-attacher-0 started at <nil> (0+0 container statuses recorded) W1024 20:26:31.276993 16756 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:31.870: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:31.870: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-3529" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sadopt\smatching\sorphans\sand\srelease\snon\-matching\spods$'
test/e2e/apps/statefulset.go:103 Oct 24 20:24:03.319: Unexpected error: <*errors.StatusError | 0xc000db6780>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_14.xml
[BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:24:00.895: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-5412 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-5412 Oct 24 20:24:03.319: FAIL: Unexpected error: <*errors.StatusError | 0xc000db6780>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001722480) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001722480) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc001722480, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:24:03.697: INFO: Deleting all statefulset in ns statefulset-5412 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-5412". �[1mSTEP�[0m: Found 0 events. Oct 24 20:24:04.638: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:24:04.638: INFO: Oct 24 20:24:04.987: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:24:05.294: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 21291 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:05.294: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:24:05.436: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:24:05.735: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:05.735: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:24:05.735: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:05.735: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:24:05.735: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:05.735: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:24:05.735: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:05.735: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:24:05.735: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:05.735: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:24:05.735: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:05.735: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:24:05.735: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:05.735: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:24:05.735: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:05.735: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:05.735: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W1024 20:24:06.068802 16681 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:24:06.914: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:24:06.914: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:07.465: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 22291 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-261":"csi-mock-csi-mock-volumes-261","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:23:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:07.465: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:07.930: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:08.528: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:24:08.528: INFO: pod-af3b40b9-3b55-4635-9416-bb3c0f499a5f started at 2020-10-24 20:23:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:24:08.528: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-nq7m4 started at 2020-10-24 20:23:36 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:08.528: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-rc2xn started at 2020-10-24 20:23:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:08.528: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:24:08.528: INFO: frontend-7659f66489-swgfc started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container guestbook-frontend ready: false, restart count 0 Oct 24 20:24:08.528: INFO: rs-lnf8g started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container donothing ready: false, restart count 0 Oct 24 20:24:08.528: INFO: netserver-0 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:08.528: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:23:24 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:24:08.528: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:08.528: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:24:08.528: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:24:08.528: INFO: netserver-0 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container webserver ready: false, restart count 0 Oct 24 20:24:08.528: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:23:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:24:08.528: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:24:08.528: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container coredns ready: true, restart count 0 Oct 24 20:24:08.528: INFO: pod-f0c1fc9d-345b-438f-852b-322f8b5fb38d started at 2020-10-24 20:23:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:24:08.528: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-xk5df started at 2020-10-24 20:23:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:08.528: INFO: csi-mockplugin-0 started at 2020-10-24 20:23:24 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:08.528: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:08.528: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:24:08.528: INFO: Container mock ready: true, restart count 0 Oct 24 20:24:08.528: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:08.528: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:08.528: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:24:08.528: INFO: csi-mockplugin-0 started at 2020-10-24 20:23:58 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:08.528: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:08.528: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:24:08.528: INFO: Container mock ready: true, restart count 0 Oct 24 20:24:08.528: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-q425d started at 2020-10-24 20:23:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:08.528: INFO: Container agnhost-container ready: true, restart count 0 W1024 20:24:08.949617 16681 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:24:10.247: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:10.247: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:10.422: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 22198 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:23:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:59 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:59 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:59 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:59 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-5ce4231c-d951-428e-a5d1-e3eb2c8081da],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-5ce4231c-d951-428e-a5d1-e3eb2c8081da,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-5ce4231c-d951-428e-a5d1-e3eb2c8081da,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:10.422: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:10.799: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:11.184: INFO: csi-mockplugin-0 started at 2020-10-24 20:22:57 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:11.184: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:11.184: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:24:11.184: INFO: Container mock ready: true, restart count 0 Oct 24 20:24:11.184: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:22:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.184: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:24:11.184: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-8mz8q started at 2020-10-24 20:23:43 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.184: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:11.184: INFO: netserver-1 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.184: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:11.184: INFO: svc-latency-rc-vxc7m started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.184: INFO: Container svc-latency-rc ready: true, restart count 0 Oct 24 20:24:11.184: INFO: local-injector started at <nil> (0+0 container statuses recorded) Oct 24 20:24:11.185: INFO: pvc-tester-q789g started at 2020-10-24 20:23:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container write-pod ready: false, restart count 0 Oct 24 20:24:11.185: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:24:11.185: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container coredns ready: true, restart count 0 Oct 24 20:24:11.185: INFO: netserver-1 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:11.185: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-xxdq7 started at 2020-10-24 20:23:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:11.185: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:11.185: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:11.185: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:24:11.185: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:24:11.185: INFO: pod-subpath-test-preprovisionedpv-ph6p started at 2020-10-24 20:24:06 +0000 UTC (2+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Init container init-volume-preprovisionedpv-ph6p ready: false, restart count 0 Oct 24 20:24:11.185: INFO: Init container test-init-subpath-preprovisionedpv-ph6p ready: false, restart count 0 Oct 24 20:24:11.185: INFO: Container test-container-subpath-preprovisionedpv-ph6p ready: false, restart count 0 Oct 24 20:24:11.185: INFO: concurrent-1603571040-c4785 started at 2020-10-24 20:24:02 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container c ready: false, restart count 0 Oct 24 20:24:11.185: INFO: e2e-test-httpd-pod started at 2020-10-24 20:24:04 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:11.185: INFO: Container e2e-test-httpd-pod ready: true, restart count 0 W1024 20:24:11.454349 16681 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:24:12.626: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:12.627: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:24:12.863: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 22530 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:23:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:08 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:08 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:08 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:24:08 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:12.864: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:24:13.116: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:24:13.467: INFO: external-provisioner-gxznn started at 2020-10-24 20:23:35 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.467: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:24:13.467: INFO: nfs-server started at 2020-10-24 20:23:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.467: INFO: Container nfs-server ready: false, restart count 0 Oct 24 20:24:13.467: INFO: successful-jobs-history-limit-1603571040-zzvfr started at 2020-10-24 20:24:03 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.467: INFO: Container c ready: false, restart count 0 Oct 24 20:24:13.467: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.467: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:24:13.467: INFO: netserver-2 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.467: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:13.467: INFO: netserver-2 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container webserver ready: false, restart count 0 Oct 24 20:24:13.468: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:24:13.468: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:13.468: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:13.468: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:24:13.468: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:24:13.468: INFO: gcepd-client started at 2020-10-24 20:23:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container gcepd-client ready: true, restart count 0 Oct 24 20:24:13.468: INFO: rs-4nnr8 started at 2020-10-24 20:23:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container donothing ready: false, restart count 0 Oct 24 20:24:13.468: INFO: pod-0cd0f30d-7c16-4b9e-bbb8-5cbb3f6a6a2f started at 2020-10-24 20:24:10 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container test-container ready: false, restart count 0 Oct 24 20:24:13.468: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:24:13.468: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:24:13.468: INFO: test-container-pod started at 2020-10-24 20:23:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:13.468: INFO: rs-9t8bj started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container donothing ready: false, restart count 0 Oct 24 20:24:13.468: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-lxllc started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:13.468: INFO: pod-subpath-test-preprovisionedpv-d6m5 started at 2020-10-24 20:24:06 +0000 UTC (1+1 container statuses recorded) Oct 24 20:24:13.468: INFO: Init container init-volume-preprovisionedpv-d6m5 ready: true, restart count 0 Oct 24 20:24:13.468: INFO: Container test-container-subpath-preprovisionedpv-d6m5 ready: true, restart count 0 W1024 20:24:13.828792 16681 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:24:14.590: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:24:14.590: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-5412" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\shave\sa\sworking\sscale\ssubresource\s\[Conformance\]$'
test/e2e/apps/statefulset.go:103 Oct 24 20:21:27.382: Unexpected error: <*errors.StatusError | 0xc000d56aa0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_10.xml
[BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:21:26.890: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-4842 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-4842 Oct 24 20:21:27.382: FAIL: Unexpected error: <*errors.StatusError | 0xc000d56aa0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002780180) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002780180) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002780180, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:21:27.461: INFO: Deleting all statefulset in ns statefulset-4842 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-4842". �[1mSTEP�[0m: Found 0 events. Oct 24 20:21:27.750: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:21:27.750: INFO: Oct 24 20:21:27.807: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:21:27.880: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 9968 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:21:27.881: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:21:27.939: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:21:28.006: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.006: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:21:28.006: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.006: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:21:28.006: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.006: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:21:28.006: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.006: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:21:28.006: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.006: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:21:28.006: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.006: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:21:28.006: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.006: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:21:28.006: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:21:28.006: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:21:28.006: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W1024 20:21:28.092052 16767 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:21:28.427: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:21:28.427: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:21:28.532: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 15980 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:21:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:21:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:17 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:17 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:17 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:21:17 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4201^7e125a31-1636-11eb-968a-caff4efe5439,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:21:28.532: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:21:28.592: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:21:28.695: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container coredns ready: true, restart count 0 Oct 24 20:21:28.695: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:21:28.695: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:21:28.695: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:21:28.695: INFO: pod-update-0632bad2-3325-436d-9a29-bbd9dc093d99 started at 2020-10-24 20:21:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container nginx ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-snapshotter-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:21:28.695: INFO: csi-hostpath-resizer-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:21:28.695: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:21:28.695: INFO: pod-2ffaac2c-cfe4-44e4-9dbb-a8cc4326bf32 started at 2020-10-24 20:19:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container write-pod ready: false, restart count 0 Oct 24 20:21:28.695: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-z4nhk started at 2020-10-24 20:21:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:21:28.695: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:21:28.695: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:21:28.695: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:21:28.695: INFO: nfs-server started at 2020-10-24 20:21:19 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container nfs-server ready: true, restart count 0 Oct 24 20:21:28.695: INFO: gluster-client started at 2020-10-24 20:21:19 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container gluster-client ready: false, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:19:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:21:28.695: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:19:32 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:28.695: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:21:28.695: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:21:28.695: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:19:52 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:28.695: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:21:28.695: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:21:28.695: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:21:28.695: INFO: netserver-0 started at 2020-10-24 20:20:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container webserver ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-attacher-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:21:28.695: INFO: pod-b7412f53-41c8-4706-b8ea-722f0abed0cf started at <nil> (0+0 container statuses recorded) Oct 24 20:21:28.695: INFO: hostpath-injector started at <nil> (0+0 container statuses recorded) Oct 24 20:21:28.695: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:19:00 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:28.695: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:21:28.695: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:21:28.695: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:21:28.695: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:19:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:28.695: INFO: Container csi-snapshotter ready: true, restart count 0 W1024 20:21:28.783376 16767 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:21:29.136: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:21:29.136: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:21:29.174: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 15186 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:18:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2020-10-24 20:21:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:20:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:20:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:20:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:20:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-a132172c-ea58-46cf-86bf-c990b7f3ac26],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-a132172c-ea58-46cf-86bf-c990b7f3ac26,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-a132172c-ea58-46cf-86bf-c990b7f3ac26,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:21:29.175: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:21:29.223: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:21:29.278: INFO: concurrent-1603570860-4wtcs started at 2020-10-24 20:21:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container c ready: true, restart count 0 Oct 24 20:21:29.278: INFO: pod-subpath-test-downwardapi-89xl started at 2020-10-24 20:21:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container test-container-subpath-downwardapi-89xl ready: true, restart count 0 Oct 24 20:21:29.278: INFO: adopt-release-x8mhf started at 2020-10-24 20:21:19 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container c ready: true, restart count 0 Oct 24 20:21:29.278: INFO: var-expansion-dca8550c-764b-4787-8ee3-17a760c6b30c started at <nil> (0+0 container statuses recorded) Oct 24 20:21:29.278: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:18:22 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:29.278: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:21:29.278: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:21:29.278: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 24 20:21:29.278: INFO: csi-mockplugin-0 started at 2020-10-24 20:18:03 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:29.278: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:21:29.278: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:21:29.278: INFO: Container mock ready: true, restart count 0 Oct 24 20:21:29.278: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:18:03 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:21:29.278: INFO: gcepd-client started at 2020-10-24 20:20:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container gcepd-client ready: true, restart count 0 Oct 24 20:21:29.278: INFO: test-container-pod started at 2020-10-24 20:21:02 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container webserver ready: true, restart count 0 Oct 24 20:21:29.278: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:18:23 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:21:29.278: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container coredns ready: true, restart count 0 Oct 24 20:21:29.278: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:18:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container csi-snapshotter ready: false, restart count 0 Oct 24 20:21:29.278: INFO: pod-client started at 2020-10-24 20:21:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container pod-client ready: true, restart count 0 Oct 24 20:21:29.278: INFO: netserver-1 started at 2020-10-24 20:20:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container webserver ready: true, restart count 0 Oct 24 20:21:29.278: INFO: pod-040d5bff-dcb0-4da2-8f4c-9dcf895853b1 started at 2020-10-24 20:21:25 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container test-container ready: false, restart count 0 Oct 24 20:21:29.278: INFO: pod2 started at 2020-10-24 20:21:25 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container agnhost-container ready: false, restart count 0 Oct 24 20:21:29.278: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:21:29.278: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:21:29.278: INFO: adopt-release-rqgr4 started at 2020-10-24 20:20:59 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container c ready: true, restart count 0 Oct 24 20:21:29.278: INFO: pod-release-dbq6n started at <nil> (0+0 container statuses recorded) Oct 24 20:21:29.278: INFO: adopt-release-dp4sx started at 2020-10-24 20:20:59 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container c ready: true, restart count 0 Oct 24 20:21:29.278: INFO: terminate-cmd-rpa7c23e562-fdec-44ba-b656-57afb13f71e5 started at 2020-10-24 20:21:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container terminate-cmd-rpa ready: false, restart count 1 Oct 24 20:21:29.278: INFO: pod-configmaps-e2fd15d7-7486-4786-94f4-44492abee464 started at 2020-10-24 20:21:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container configmap-volume-test ready: true, restart count 0 Oct 24 20:21:29.278: INFO: sample-apiserver-deployment-67dc674868-5b4qr started at <nil> (0+0 container statuses recorded) Oct 24 20:21:29.278: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:21:29.278: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:21:29.278: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:21:29.278: INFO: downward-api-8ad283e2-806f-4692-a631-36771a60373b started at 2020-10-24 20:21:23 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container dapi-container ready: false, restart count 0 Oct 24 20:21:29.278: INFO: gluster-server started at 2020-10-24 20:20:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:29.278: INFO: Container gluster-server ready: true, restart count 0 W1024 20:21:29.326085 16767 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:21:29.939: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:21:29.939: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:21:29.977: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 15962 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:18:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2020-10-24 20:18:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:21:27 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-9914^4 kubernetes.io/gce-pd/e2e-102521e575-a7d53-c5c3b8a0-b64e-4bd9-ab2e-3b8a5c81b835 kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-0d8c3ef0-316e-4a37-abdd-b4226fde5644],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-c5c3b8a0-b64e-4bd9-ab2e-3b8a5c81b835,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-c5c3b8a0-b64e-4bd9-ab2e-3b8a5c81b835,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9914^4,DevicePath:,},AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-0d8c3ef0-316e-4a37-abdd-b4226fde5644,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-0d8c3ef0-316e-4a37-abdd-b4226fde5644,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:21:29.977: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:21:30.026: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:21:30.108: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:20:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:21:30.108: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:20:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:21:30.108: INFO: csi-mockplugin-0 started at 2020-10-24 20:20:41 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container mock ready: true, restart count 0 Oct 24 20:21:30.108: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:20:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pod-server-1 started at 2020-10-24 20:21:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container agnhost-container ready: false, restart count 0 Oct 24 20:21:30.108: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:21:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pvc-volume-tester-jsjc7 started at 2020-10-24 20:21:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container volume-tester ready: true, restart count 0 Oct 24 20:21:30.108: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:20:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pod-subpath-test-configmap-9rmz started at 2020-10-24 20:20:11 +0000 UTC (1+2 container statuses recorded) Oct 24 20:21:30.108: INFO: Init container init-volume-configmap-9rmz ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container test-container-subpath-configmap-9rmz ready: true, restart count 3 Oct 24 20:21:30.108: INFO: Container test-container-volume-configmap-9rmz ready: true, restart count 0 Oct 24 20:21:30.108: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:20:17 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:21:30.108: INFO: gcepd-injector started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container gcepd-injector ready: false, restart count 0 Oct 24 20:21:30.108: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:21:30.108: INFO: csi-mockplugin-0 started at 2020-10-24 20:21:00 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:30.108: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container mock ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pod-ephm-test-projected-jbqr started at 2020-10-24 20:20:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container test-container-subpath-projected-jbqr ready: false, restart count 0 Oct 24 20:21:30.108: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:21:30.108: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:21:30.108: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:21:30.108: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pod-ready started at 2020-10-24 20:20:38 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container pod-readiness-gate ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pod-configmaps-69e814ab-2f4b-458a-ac45-4ba57678187d started at 2020-10-24 20:21:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container env-test ready: false, restart count 0 Oct 24 20:21:30.108: INFO: netserver-2 started at 2020-10-24 20:20:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container webserver ready: true, restart count 0 Oct 24 20:21:30.108: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:21:30.108: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pod1 started at 2020-10-24 20:21:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:21:30.108: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:20:16 +0000 UTC (0+3 container statuses recorded) Oct 24 20:21:30.108: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:21:30.108: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:21:30.108: INFO: pod-bc99b556-eb71-49e4-a167-baaddd37a3a5 started at 2020-10-24 20:19:35 +0000 UTC (0+1 container statuses recorded) Oct 24 20:21:30.108: INFO: Container write-pod ready: true, restart count 0 W1024 20:21:30.160143 16767 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:21:31.966: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:21:31.966: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-4842" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\simplement\slegacy\sreplacement\swhen\sthe\supdate\sstrategy\sis\sOnDelete$'
test/e2e/apps/statefulset.go:103 Oct 24 20:26:13.151: Unexpected error: <*errors.StatusError | 0xc000ff2dc0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_12.xml
[BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:26:12.409: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-4869 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-4869 Oct 24 20:26:13.151: FAIL: Unexpected error: <*errors.StatusError | 0xc000ff2dc0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002a54600) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002a54600) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002a54600, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:26:13.252: INFO: Deleting all statefulset in ns statefulset-4869 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-4869". �[1mSTEP�[0m: Found 0 events. Oct 24 20:26:13.699: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:26:13.699: INFO: Oct 24 20:26:13.827: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:26:13.908: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 21291 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:13.909: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:26:13.998: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:26:14.093: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.093: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:26:14.093: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.093: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:26:14.093: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.093: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:26:14.093: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.093: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:26:14.093: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.093: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:26:14.093: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.093: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:26:14.093: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.093: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:26:14.093: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:14.093: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:14.093: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 W1024 20:26:14.199955 16671 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:14.686: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:26:14.686: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:14.765: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 24116 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4306":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-5994":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-5360":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-261":"csi-mock-csi-mock-volumes-261","csi-mock-csi-mock-volumes-7525":"csi-mock-csi-mock-volumes-7525","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kubelet Update v1 2020-10-24 20:24:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:24:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:14.766: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:14.855: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:14.989: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:14.989: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:14.989: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:08 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:14.989: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-mockplugin-0 started at 2020-10-24 20:23:58 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container driver-registrar ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container mock ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:24:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:26:14.989: INFO: webserver-7768b89c5b-hxg66 started at 2020-10-24 20:26:10 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:14.989: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:24:10 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-snapshotter ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:26:14.989: INFO: inline-volume-tester-zxlzn started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-volume-tester ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:26:14.989: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-kwcbx started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:26:14.989: INFO: fail-once-non-local-8jhht started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container c ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:28 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:14.989: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:28 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:14.989: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:26:14.989: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:26:14.989: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:26:14.989: INFO: netserver-0 started at 2020-10-24 20:24:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container webserver ready: false, restart count 0 Oct 24 20:26:14.989: INFO: affinity-clusterip-transition-52xfd started at 2020-10-24 20:26:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Oct 24 20:26:14.989: INFO: webserver-7768b89c5b-jb2tp started at 2020-10-24 20:26:02 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:14.989: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:23:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:24:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:24:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-attacher ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-mockplugin-0 started at 2020-10-24 20:24:24 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container driver-registrar ready: false, restart count 0 Oct 24 20:26:14.989: INFO: Container mock ready: false, restart count 0 Oct 24 20:26:14.989: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:26:14.989: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container coredns ready: true, restart count 0 Oct 24 20:26:14.989: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:14.989: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:26:14.989: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:26:14.989: INFO: netserver-0 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container webserver ready: false, restart count 0 Oct 24 20:26:14.989: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:26:14.989: INFO: fail-once-non-local-qg5lr started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:14.989: INFO: Container c ready: false, restart count 0 W1024 20:26:15.089309 16671 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:16.242: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:26:16.242: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:16.339: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 28439 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-volume-expand-199":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-1202":"csi-mock-csi-mock-volumes-1202","csi-mock-csi-mock-volumes-167":"csi-mock-csi-mock-volumes-167","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-9175":"csi-mock-csi-mock-volumes-9175","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:26:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:26:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:io.kubernetes.storage.mock/node":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:26:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-1202^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-1202^4,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:16.339: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:16.417: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:16.731: INFO: all-succeed-g8vg2 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:16.731: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:26:16.731: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container coredns ready: true, restart count 0 Oct 24 20:26:16.731: INFO: csi-mockplugin-0 started at 2020-10-24 20:25:30 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:16.731: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:26:16.731: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:26:16.731: INFO: Container mock ready: true, restart count 0 Oct 24 20:26:16.731: INFO: nfs-server started at 2020-10-24 20:24:48 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container nfs-server ready: false, restart count 0 Oct 24 20:26:16.731: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:25:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:26:16.731: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:16.731: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:16.731: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:26:16.731: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:26:16.731: INFO: csi-mockplugin-0 started at 2020-10-24 20:25:57 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:16.731: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:26:16.731: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:26:16.731: INFO: Container mock ready: true, restart count 0 Oct 24 20:26:16.731: INFO: busybox-2909d4f8-e859-4c4d-bfb0-40d3844685ba started at 2020-10-24 20:24:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container busybox ready: true, restart count 0 Oct 24 20:26:16.731: INFO: pod-configmaps-59b74d1f-f3a7-4c5e-a825-72f9af63a7d1 started at 2020-10-24 20:24:40 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:16.731: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Oct 24 20:26:16.731: INFO: Container configmap-volume-data-test ready: false, restart count 0 Oct 24 20:26:16.731: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container csi-snapshotter ready: false, restart count 0 Oct 24 20:26:16.731: INFO: liveness-da84de3e-0a18-4838-95dd-25b912f87d16 started at 2020-10-24 20:25:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.731: INFO: Container liveness ready: true, restart count 3 Oct 24 20:26:16.732: INFO: all-succeed-bn8lx started at <nil> (0+0 container statuses recorded) Oct 24 20:26:16.732: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:26:07 +0000 UTC (0+3 container statuses recorded) Oct 24 20:26:16.732: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:26:16.732: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:26:16.732: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:26:16.732: INFO: execpod-affinitysscmt started at <nil> (0+0 container statuses recorded) Oct 24 20:26:16.732: INFO: test-webserver-880fc7db-0c4f-4dc5-8a7e-da95a2a1d260 started at 2020-10-24 20:24:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container test-webserver ready: false, restart count 0 Oct 24 20:26:16.732: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:26:16.732: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:25:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:26:16.732: INFO: test-container-pod started at 2020-10-24 20:24:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container webserver ready: false, restart count 0 Oct 24 20:26:16.732: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:26:10 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container csi-attacher ready: false, restart count 0 Oct 24 20:26:16.732: INFO: webserver-7768b89c5b-mfktq started at 2020-10-24 20:25:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:16.732: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:26:16.732: INFO: netserver-1 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container webserver ready: false, restart count 0 Oct 24 20:26:16.732: INFO: affinity-clusterip-transition-9vvcg started at 2020-10-24 20:26:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Oct 24 20:26:16.732: INFO: webserver-7768b89c5b-hmvft started at 2020-10-24 20:26:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:16.732: INFO: pvc-volume-tester-72tdl started at 2020-10-24 20:26:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:16.732: INFO: Container volume-tester ready: false, restart count 0 W1024 20:26:16.868353 16671 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:18.656: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:26:18.656: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:18.747: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 28424 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-6603":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:25:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2020-10-24 20:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:10 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:10 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:26:10 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:26:10 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-6e6f84b4-9eaf-4bb3-af44-32218242f6cd],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-6e6f84b4-9eaf-4bb3-af44-32218242f6cd,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-6e6f84b4-9eaf-4bb3-af44-32218242f6cd,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:26:18.747: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:18.817: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:18.985: INFO: bin-false91d63ac6-5f14-4bb0-960e-453cac04f625 started at 2020-10-24 20:25:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container bin-false91d63ac6-5f14-4bb0-960e-453cac04f625 ready: false, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-mountsa started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container token-test ready: false, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-defaultsa-mountspec started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-mountsa-nomountspec started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:18.985: INFO: httpd started at 2020-10-24 20:25:47 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:18.985: INFO: pod-with-prestop-http-hook started at 2020-10-24 20:25:43 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container pod-with-prestop-http-hook ready: false, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-nomountsa started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:18.985: INFO: labelsupdate8f8854b1-0bdf-4451-b060-745ce24df25d started at 2020-10-24 20:25:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container client-container ready: false, restart count 0 Oct 24 20:26:18.985: INFO: pod-handle-http-request started at 2020-10-24 20:25:32 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:26:18.985: INFO: affinity-clusterip-transition-gsrqc started at 2020-10-24 20:26:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Oct 24 20:26:18.985: INFO: update-demo-nautilus-qjr69 started at 2020-10-24 20:25:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container update-demo ready: false, restart count 0 Oct 24 20:26:18.985: INFO: webserver-7768b89c5b-97m4f started at 2020-10-24 20:26:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-defaultsa-nomountspec started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container token-test ready: true, restart count 0 Oct 24 20:26:18.985: INFO: nfs-server started at <nil> (0+0 container statuses recorded) Oct 24 20:26:18.985: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:26:18.985: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:26:18.985: INFO: termination-message-containerd3eed662-5586-4bc0-a9a9-52f5dbe464c9 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:18.985: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:26:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:26:18.985: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:26:18.985: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:26:18.985: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:26:18.985: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:26:18.985: INFO: startup-eb3b4e82-6f73-4e77-a322-36124c06e6b9 started at 2020-10-24 20:24:18 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container busybox ready: false, restart count 0 Oct 24 20:26:18.985: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:18.985: INFO: pod-service-account-nomountsa-nomountspec started at <nil> (0+0 container statuses recorded) Oct 24 20:26:18.985: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:26:18.985: INFO: gcepd-injector started at 2020-10-24 20:25:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container gcepd-injector ready: true, restart count 0 Oct 24 20:26:18.985: INFO: pod-0 started at 2020-10-24 20:25:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container donothing ready: false, restart count 0 Oct 24 20:26:18.985: INFO: success started at <nil> (0+0 container statuses recorded) Oct 24 20:26:18.985: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:26:18.985: INFO: webhook-to-be-mutated started at 2020-10-24 20:26:00 +0000 UTC (1+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Init container webhook-added-init-container ready: false, restart count 0 Oct 24 20:26:18.985: INFO: Container example ready: false, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-defaultsa started at 2020-10-24 20:26:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container token-test ready: false, restart count 0 Oct 24 20:26:18.985: INFO: webserver-7768b89c5b-vwvms started at 2020-10-24 20:25:59 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container httpd ready: true, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-mountsa-mountspec started at 2020-10-24 20:26:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container token-test ready: false, restart count 0 Oct 24 20:26:18.985: INFO: csi-mockplugin-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:26:18.985: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:26:18.985: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:26:18.985: INFO: pod-service-account-nomountsa-mountspec started at <nil> (0+0 container statuses recorded) W1024 20:26:19.224401 16671 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:26:19.794: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:26:19.794: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-4869" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\snot\sdeadlock\swhen\sa\spod\'s\spredecessor\sfails$'
test/e2e/apps/statefulset.go:103 Oct 24 20:22:45.252: Unexpected error: <*errors.StatusError | 0xc00133d860>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_24.xml
[BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:22:44.788: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-7950 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-7950 Oct 24 20:22:45.252: FAIL: Unexpected error: <*errors.StatusError | 0xc00133d860>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0029b6480) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0029b6480) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0029b6480, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:22:45.300: INFO: Deleting all statefulset in ns statefulset-7950 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-7950". �[1mSTEP�[0m: Found 0 events. Oct 24 20:22:45.543: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:22:45.543: INFO: Oct 24 20:22:45.619: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:22:45.665: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 9968 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:45.666: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:22:45.733: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:22:45.791: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:45.791: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:22:45.791: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:45.791: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:45.791: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:45.791: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:45.791: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:22:45.791: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:45.791: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:22:45.791: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:45.791: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:22:45.791: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:45.791: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:22:45.791: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:45.791: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:22:45.791: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:45.791: INFO: Container kube-addon-manager ready: true, restart count 0 W1024 20:22:45.892170 16821 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:46.237: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:22:46.237: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:46.284: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 18528 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:22:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {kube-controller-manager Update v1 2020-10-24 20:22:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:22:38 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:22:38 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:22:38 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:22:38 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-b7c01ee4-e0ac-4412-aedd-8f3c99f5c9a6],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-b7c01ee4-e0ac-4412-aedd-8f3c99f5c9a6,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-b7c01ee4-e0ac-4412-aedd-8f3c99f5c9a6,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:46.284: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:46.362: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:46.425: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container csi-attacher ready: false, restart count 0 Oct 24 20:22:46.425: INFO: run-log-test started at 2020-10-24 20:22:38 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container run-log-test ready: true, restart count 0 Oct 24 20:22:46.425: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:21:19 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:46.425: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:22:46.425: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:22:46.425: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:22:46.425: INFO: hostpath-client started at 2020-10-24 20:22:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container hostpath-client ready: false, restart count 0 Oct 24 20:22:46.425: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:22:46.425: INFO: pfpod started at 2020-10-24 20:22:39 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:46.425: INFO: Container portforwardtester ready: true, restart count 0 Oct 24 20:22:46.425: INFO: Container readiness ready: false, restart count 0 Oct 24 20:22:46.425: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:19:32 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:46.425: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:22:46.425: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:22:46.425: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 24 20:22:46.425: INFO: gcepd-client started at 2020-10-24 20:22:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container gcepd-client ready: false, restart count 0 Oct 24 20:22:46.425: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:21:21 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:22:46.425: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:22:46.425: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container coredns ready: true, restart count 0 Oct 24 20:22:46.425: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:46.425: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:22:46.425: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:22:46.425: INFO: pod-qos-class-1c5c76e5-88c2-46dc-8521-aeaaf578610b started at 2020-10-24 20:22:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container agnhost ready: true, restart count 0 Oct 24 20:22:46.425: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:22:46.425: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:22:46.425: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:22:46.425: INFO: all-pods-removed-pqs4f started at 2020-10-24 20:22:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container c ready: true, restart count 0 Oct 24 20:22:46.425: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:46.425: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:46.425: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:46.425: INFO: pod-client started at 2020-10-24 20:22:25 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:46.425: INFO: Container pod-client ready: true, restart count 0 W1024 20:22:46.489266 16821 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:46.990: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:46.990: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:47.061: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 16704 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:21:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:21:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:47.061: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:47.178: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:47.273: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:47.274: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:47.274: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:47.274: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:22:47.274: INFO: pod-server-1 started at 2020-10-24 20:22:27 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:22:47.274: INFO: hostpath-symlink-prep-provisioning-5062 started at 2020-10-24 20:22:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container init-volume-provisioning-5062 ready: false, restart count 0 Oct 24 20:22:47.274: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-vvqhw started at 2020-10-24 20:22:43 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container agnhost-container ready: false, restart count 0 Oct 24 20:22:47.274: INFO: pod-configmaps-e2fd15d7-7486-4786-94f4-44492abee464 started at 2020-10-24 20:21:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container configmap-volume-test ready: false, restart count 0 Oct 24 20:22:47.274: INFO: gluster-server started at 2020-10-24 20:20:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:22:47.274: INFO: pod-projected-configmaps-011cd241-1bae-4a2a-86e6-ee31741ab51a started at 2020-10-24 20:21:35 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:47.274: INFO: Container createcm-volume-test ready: true, restart count 0 Oct 24 20:22:47.274: INFO: Container delcm-volume-test ready: true, restart count 0 Oct 24 20:22:47.274: INFO: Container updcm-volume-test ready: true, restart count 0 Oct 24 20:22:47.274: INFO: pod-server-2 started at <nil> (0+0 container statuses recorded) Oct 24 20:22:47.274: INFO: gluster-server started at 2020-10-24 20:22:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:22:47.274: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-z49lw started at 2020-10-24 20:22:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:22:47.274: INFO: gluster-server started at 2020-10-24 20:22:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container gluster-server ready: true, restart count 0 Oct 24 20:22:47.274: INFO: pod-subpath-test-inlinevolume-6c27 started at <nil> (0+0 container statuses recorded) Oct 24 20:22:47.274: INFO: external-provisioner-n9587 started at 2020-10-24 20:21:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:22:47.274: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-vwztx started at 2020-10-24 20:22:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:22:47.274: INFO: concurrent-1603570920-7tbh5 started at 2020-10-24 20:22:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container c ready: true, restart count 0 Oct 24 20:22:47.274: INFO: glusterdynamic-provisioner-x8s9s started at 2020-10-24 20:22:12 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container glusterdynamic-provisioner ready: true, restart count 0 Oct 24 20:22:47.274: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:22:47.274: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container coredns ready: true, restart count 0 Oct 24 20:22:47.274: INFO: nfs-client started at 2020-10-24 20:22:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container nfs-client ready: false, restart count 0 Oct 24 20:22:47.274: INFO: agnhost-primary-whj6g started at 2020-10-24 20:22:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container agnhost-primary ready: false, restart count 0 Oct 24 20:22:47.274: INFO: pod-submit-remove-7114c3d2-d790-4453-b358-54bc965b1106 started at 2020-10-24 20:22:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:47.274: INFO: Container agnhost-container ready: false, restart count 0 W1024 20:22:47.432657 16821 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:49.437: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:49.437: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:49.478: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 16686 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:18:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:21:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:49.478: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:49.553: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:49.670: INFO: busybox-host-aliases919276e8-2683-4b06-ac29-33db6d430270 started at 2020-10-24 20:22:18 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.670: INFO: Container busybox-host-aliases919276e8-2683-4b06-ac29-33db6d430270 ready: true, restart count 0 Oct 24 20:22:49.670: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-mw65v started at 2020-10-24 20:22:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:22:49.671: INFO: httpd started at 2020-10-24 20:22:21 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container httpd ready: true, restart count 0 Oct 24 20:22:49.671: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:22:49.671: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:22:49.671: INFO: pod-projected-secrets-fa902678-5e86-4fdb-81bc-8f3da3da2132 started at 2020-10-24 20:21:42 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:49.671: INFO: Container creates-volume-test ready: true, restart count 0 Oct 24 20:22:49.671: INFO: Container dels-volume-test ready: true, restart count 0 Oct 24 20:22:49.671: INFO: Container upds-volume-test ready: true, restart count 0 Oct 24 20:22:49.671: INFO: pod-2287b8f5-2fac-43c1-94ad-0178a2300718 started at 2020-10-24 20:22:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container write-pod ready: false, restart count 0 Oct 24 20:22:49.671: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:21:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container csi-attacher ready: false, restart count 0 Oct 24 20:22:49.671: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-lmzhd started at 2020-10-24 20:22:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:22:49.671: INFO: all-pods-removed-wdljb started at 2020-10-24 20:22:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container c ready: true, restart count 0 Oct 24 20:22:49.671: INFO: pod-subpath-test-inlinevolume-zpxx started at 2020-10-24 20:22:49 +0000 UTC (2+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Init container init-volume-inlinevolume-zpxx ready: false, restart count 0 Oct 24 20:22:49.671: INFO: Init container test-init-volume-inlinevolume-zpxx ready: false, restart count 0 Oct 24 20:22:49.671: INFO: Container test-container-subpath-inlinevolume-zpxx ready: false, restart count 0 Oct 24 20:22:49.671: INFO: external-provisioner-8xk9l started at 2020-10-24 20:22:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:22:49.671: INFO: nfs-server started at 2020-10-24 20:22:44 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container nfs-server ready: true, restart count 0 Oct 24 20:22:49.671: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:22:49.671: INFO: csi-mockplugin-0 started at 2020-10-24 20:21:00 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:49.671: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:22:49.671: INFO: Container driver-registrar ready: false, restart count 0 Oct 24 20:22:49.671: INFO: Container mock ready: false, restart count 0 Oct 24 20:22:49.671: INFO: external-provisioner-6d5xq started at 2020-10-24 20:22:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:22:49.671: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:49.671: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:49.671: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:49.671: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:22:49.671: INFO: gluster-server started at 2020-10-24 20:22:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container gluster-server ready: true, restart count 0 Oct 24 20:22:49.671: INFO: gluster-server started at 2020-10-24 20:22:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container gluster-server ready: true, restart count 0 Oct 24 20:22:49.671: INFO: exec-volume-test-preprovisionedpv-42bg started at 2020-10-24 20:22:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container exec-container-preprovisionedpv-42bg ready: false, restart count 0 Oct 24 20:22:49.671: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:49.671: INFO: Container autoscaler ready: true, restart count 0 W1024 20:22:49.722713 16821 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:51.604: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:51.604: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-7950" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sperform\scanary\supdates\sand\sphased\srolling\supdates\sof\stemplate\smodifications\s\[Conformance\]$'
test/e2e/apps/statefulset.go:103 Oct 24 20:29:53.624: Unexpected error: <*errors.StatusError | 0xc002d1e8c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_07.xml
{"msg":"PASSED [sig-storage] In-tree Volumes [Driver: gcepd] [Testpattern: Inline-volume (ext4)] volumes should store data","total":-1,"completed":28,"skipped":113,"failed":0} [BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:29:53.191: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-2250 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-2250 Oct 24 20:29:53.624: FAIL: Unexpected error: <*errors.StatusError | 0xc002d1e8c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc0010f2180) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc0010f2180) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc0010f2180, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:29:53.661: INFO: Deleting all statefulset in ns statefulset-2250 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-2250". �[1mSTEP�[0m: Found 0 events. Oct 24 20:29:53.943: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:29:53.943: INFO: Oct 24 20:29:53.990: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:29:54.094: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 35251 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:29:54.095: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:29:54.174: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:29:54.269: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.269: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:29:54.269: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:54.269: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:29:54.269: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:29:54.269: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.269: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:29:54.269: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.269: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:29:54.269: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.269: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:29:54.269: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.269: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:29:54.269: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.269: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:29:54.269: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.269: INFO: Container kube-addon-manager ready: true, restart count 0 W1024 20:29:54.346482 16664 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:29:54.646: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:29:54.646: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:54.685: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 38196 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4306":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-3917":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4518":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-5994":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-5360":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-261":"csi-mock-csi-mock-volumes-261","csi-mock-csi-mock-volumes-4133":"csi-mock-csi-mock-volumes-4133","csi-mock-csi-mock-volumes-7525":"csi-mock-csi-mock-volumes-7525","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:28:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:28:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {e2e.test Update v1 2020-10-24 20:29:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{},"f:mounted_volume_expand":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:51 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:51 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:51 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:29:51 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:2002029,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-4518^8c49ccd4-1637-11eb-93bf-8e3690743349],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-4518^8c49ccd4-1637-11eb-93bf-8e3690743349,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:29:54.686: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:54.736: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:54.837: INFO: client-containers-87666167-afe7-4205-94dc-b4d7cc63ac73 started at <nil> (0+0 container statuses recorded) Oct 24 20:29:54.837: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:28:55 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:29:54.837: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:29:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:29:54.837: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-9svx9 started at 2020-10-24 20:29:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.837: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:29:54.837: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container coredns ready: true, restart count 0 Oct 24 20:29:54.837: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:54.837: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:29:54.837: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:29:54.837: INFO: privileged-pod started at 2020-10-24 20:28:42 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:54.837: INFO: Container not-privileged-container ready: false, restart count 0 Oct 24 20:29:54.837: INFO: Container privileged-container ready: false, restart count 0 Oct 24 20:29:54.837: INFO: service-proxy-disabled-sxwqj started at 2020-10-24 20:28:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container service-proxy-disabled ready: true, restart count 0 Oct 24 20:29:54.837: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:29:54.837: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-jdvtr started at 2020-10-24 20:29:50 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container agnhost-container ready: false, restart count 0 Oct 24 20:29:54.837: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-75klc started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.837: INFO: affinity-nodeport-transition-7m54b started at 2020-10-24 20:29:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 24 20:29:54.837: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:54.837: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:29:54.837: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:29:54.837: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:27:51 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:54.837: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:29:54.837: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:29:54.837: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 24 20:29:54.837: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:28:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:29:54.837: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container csi-attacher ready: false, restart count 0 Oct 24 20:29:54.837: INFO: pod-bbd31f60-f881-483f-a69e-a42941fb2eec started at 2020-10-24 20:29:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:29:54.837: INFO: startup-d4d19061-7d02-4eb6-9047-e3864a125b1a started at 2020-10-24 20:29:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container busybox ready: false, restart count 0 Oct 24 20:29:54.837: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-rzbpr started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.837: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-7s5r9 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.837: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-7k8rm started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.837: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-l5wkg started at 2020-10-24 20:29:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.837: INFO: logs-generator started at 2020-10-24 20:29:43 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container logs-generator ready: true, restart count 0 Oct 24 20:29:54.837: INFO: security-context-8b5ddbd8-a1f5-4cb0-8d4a-fb84159035e3 started at 2020-10-24 20:29:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container test-container ready: false, restart count 0 Oct 24 20:29:54.837: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:29:54.837: INFO: test-rolling-update-with-lb-5b74d4d4b5-d4dqx started at 2020-10-24 20:29:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.837: INFO: Container agnhost ready: true, restart count 0 Oct 24 20:29:54.837: INFO: csi-mockplugin-0 started at 2020-10-24 20:29:20 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:54.838: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:29:54.838: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:29:54.838: INFO: Container mock ready: true, restart count 0 Oct 24 20:29:54.838: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-glptq started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.838: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-79d89 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.838: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-948g2 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.838: INFO: service-proxy-toggled-4x5v7 started at 2020-10-24 20:28:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container service-proxy-toggled ready: true, restart count 0 Oct 24 20:29:54.838: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-bgg5c started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:54.838: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:28:54 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:54.838: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:29:54.838: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:29:54.838: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:29:54.838: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:28:55 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:29:54.838: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:28:55 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:29:54.838: INFO: httpd-deployment-5c84db5954-8z8xj started at 2020-10-24 20:29:36 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container httpd ready: false, restart count 0 Oct 24 20:29:54.838: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:27:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:54.838: INFO: Container csi-snapshotter ready: false, restart count 0 W1024 20:29:54.935975 16664 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:29:55.451: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:55.451: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:29:55.557: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 38216 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-ephemeral-9589":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-4925":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-volume-expand-199":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-1202":"csi-mock-csi-mock-volumes-1202","csi-mock-csi-mock-volumes-167":"csi-mock-csi-mock-volumes-167","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-4875":"csi-mock-csi-mock-volumes-4875","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-8443":"csi-mock-csi-mock-volumes-8443","csi-mock-csi-mock-volumes-9175":"csi-mock-csi-mock-volumes-9175","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:29:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {e2e.test Update v1 2020-10-24 20:29:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}}} {kubelet Update v1 2020-10-24 20:29:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:io.kubernetes.storage.mock/node":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:53 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:53 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:53 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:29:53 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:29:55.557: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:29:55.815: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-sskwb started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-gkcl5 started at 2020-10-24 20:29:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: service-proxy-toggled-lgxmj started at 2020-10-24 20:28:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container service-proxy-toggled ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-fh9hg started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-xkn9w started at 2020-10-24 20:29:38 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:29:56.109: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:29:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-zhfvg started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-g24qr started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-n6c4t started at 2020-10-24 20:29:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: httpd-deployment-5c84db5954-lgqj7 started at 2020-10-24 20:29:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container httpd ready: false, restart count 0 Oct 24 20:29:56.109: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:29:56.109: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container coredns ready: true, restart count 0 Oct 24 20:29:56.109: INFO: slave started at 2020-10-24 20:29:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cntr ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-fd2rj started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:29:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-rm664 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: affinity-nodeport-transition-vdzdc started at 2020-10-24 20:29:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Oct 24 20:29:56.109: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:56.109: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:29:56.109: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:29:56.109: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:29:56.109: INFO: private started at 2020-10-24 20:29:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cntr ready: true, restart count 0 Oct 24 20:29:56.109: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:29:07 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:56.109: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:29:56.109: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:29:56.109: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:29:56.109: INFO: test-rolling-update-with-lb-5b74d4d4b5-7mjr7 started at 2020-10-24 20:29:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container agnhost ready: true, restart count 0 Oct 24 20:29:56.109: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-nc6pj started at 2020-10-24 20:29:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.109: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:29:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:29:56.109: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:29:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:29:56.109: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:28:35 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.109: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:29:56.109: INFO: service-proxy-disabled-nmg7g started at 2020-10-24 20:28:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container service-proxy-disabled ready: true, restart count 0 Oct 24 20:29:56.110: INFO: csi-mockplugin-0 started at 2020-10-24 20:29:14 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:56.110: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:29:56.110: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:29:56.110: INFO: Container mock ready: true, restart count 0 Oct 24 20:29:56.110: INFO: master started at 2020-10-24 20:29:19 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container cntr ready: true, restart count 0 Oct 24 20:29:56.110: INFO: inline-volume-tester-j7w49 started at 2020-10-24 20:29:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container csi-volume-tester ready: false, restart count 0 Oct 24 20:29:56.110: INFO: pvc-volume-tester-6dhh8 started at 2020-10-24 20:29:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container volume-tester ready: false, restart count 0 Oct 24 20:29:56.110: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:29:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:29:56.110: INFO: default started at 2020-10-24 20:29:32 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container cntr ready: true, restart count 0 Oct 24 20:29:56.110: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-b5mg5 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:56.110: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-mqr8k started at 2020-10-24 20:29:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:56.110: INFO: Container agnhost-container ready: true, restart count 0 W1024 20:29:56.500902 16664 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:29:57.255: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:29:57.255: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:29:57.383: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 38237 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-4858":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-6603":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-7825":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-701":"csi-mock-csi-mock-volumes-701","csi-mock-csi-mock-volumes-8880":"csi-mock-csi-mock-volumes-8880","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:29:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {e2e.test Update v1 2020-10-24 20:29:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}}} {kubelet Update v1 2020-10-24 20:29:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:52 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:52 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:52 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:29:52 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:29:57.384: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:29:57.512: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:29:57.657: INFO: service-proxy-disabled-ztgw8 started at 2020-10-24 20:28:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.657: INFO: Container service-proxy-disabled ready: true, restart count 0 Oct 24 20:29:57.657: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-tdqpb started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.657: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.657: INFO: pod-init-cec9f34b-ad78-492c-b0e5-f6038b8e599d started at 2020-10-24 20:29:16 +0000 UTC (2+1 container statuses recorded) Oct 24 20:29:57.657: INFO: Init container init1 ready: false, restart count 2 Oct 24 20:29:57.657: INFO: Init container init2 ready: false, restart count 0 Oct 24 20:29:57.658: INFO: Container run1 ready: false, restart count 0 Oct 24 20:29:57.658: INFO: verify-service-up-exec-pod-gtmpt started at <nil> (0+0 container statuses recorded) Oct 24 20:29:57.658: INFO: pod-submit-status-2-5 started at 2020-10-24 20:29:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container busybox ready: false, restart count 0 Oct 24 20:29:57.658: INFO: httpd-deployment-5c84db5954-vx24v started at 2020-10-24 20:29:36 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container httpd ready: false, restart count 0 Oct 24 20:29:57.658: INFO: affinity-nodeport-transition-slbkz started at <nil> (0+0 container statuses recorded) Oct 24 20:29:57.658: INFO: pod-subpath-test-preprovisionedpv-mdjx started at <nil> (0+0 container statuses recorded) Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-ppq5h started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-qlwmw started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: false, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-npfrj started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: exec-volume-test-dynamicpv-5sx8 started at <nil> (0+0 container statuses recorded) Oct 24 20:29:57.658: INFO: test-rolling-update-with-lb-5b74d4d4b5-4ksd8 started at 2020-10-24 20:29:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container agnhost ready: true, restart count 0 Oct 24 20:29:57.658: INFO: external-provisioner-9tqpz started at 2020-10-24 20:29:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-tvxh2 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:29:57.658: INFO: service-proxy-toggled-xz9vk started at 2020-10-24 20:28:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container service-proxy-toggled ready: true, restart count 0 Oct 24 20:29:57.658: INFO: pod-submit-status-0-3 started at 2020-10-24 20:29:38 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container busybox ready: false, restart count 0 Oct 24 20:29:57.658: INFO: pod-submit-status-1-1 started at 2020-10-24 20:29:27 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container busybox ready: false, restart count 0 Oct 24 20:29:57.658: INFO: gluster-server started at 2020-10-24 20:29:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container gluster-server ready: true, restart count 0 Oct 24 20:29:57.658: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-dqqjx started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:57.658: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:29:57.658: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:29:57.658: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:29:57.658: INFO: pod-configmaps-b71ff011-12c7-46b3-b66b-c82142a36694 started at 2020-10-24 20:28:58 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:57.658: INFO: Container createcm-volume-test ready: true, restart count 0 Oct 24 20:29:57.658: INFO: Container delcm-volume-test ready: true, restart count 0 Oct 24 20:29:57.658: INFO: Container updcm-volume-test ready: true, restart count 0 Oct 24 20:29:57.658: INFO: pod-subpath-test-dynamicpv-zl92 started at <nil> (0+0 container statuses recorded) Oct 24 20:29:57.658: INFO: verify-service-up-host-exec-pod started at 2020-10-24 20:29:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:29:57.658: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-vlrg7 started at 2020-10-24 20:29:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-75824 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-tktzc started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-xpqr7 started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: my-hostname-basic-7f141226-bae9-44d3-86e6-fce4c43e63b7-kz2dz started at 2020-10-24 20:29:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container my-hostname-basic-7f141226-bae9-44d3-86e6-fce4c43e63b7 ready: true, restart count 0 Oct 24 20:29:57.658: INFO: pod-subpath-test-inlinevolume-fxvg started at 2020-10-24 20:29:29 +0000 UTC (1+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Init container init-volume-inlinevolume-fxvg ready: true, restart count 0 Oct 24 20:29:57.658: INFO: Container test-container-subpath-inlinevolume-fxvg ready: true, restart count 0 Oct 24 20:29:57.658: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:29:57.658: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:29:57.658: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-82c8q started at 2020-10-24 20:29:32 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:29:57.658: INFO: cleanup30-619ddb06-f741-419d-9bfa-807f04484da3-gfqxg started at 2020-10-24 20:29:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:57.658: INFO: Container cleanup30-619ddb06-f741-419d-9bfa-807f04484da3 ready: false, restart count 0 Oct 24 20:29:57.658: INFO: pod-subpath-test-dynamicpv-7t7r started at <nil> (0+0 container statuses recorded) W1024 20:29:57.735928 16664 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:29:58.137: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:29:58.137: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-2250" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sperform\srolling\supdates\sand\sroll\sbacks\sof\stemplate\smodifications\s\[Conformance\]$'
test/e2e/apps/statefulset.go:103 Oct 24 20:23:34.557: Unexpected error: <*errors.StatusError | 0xc00154e0a0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_16.xml
[BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:23:32.583: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-8613 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-8613 Oct 24 20:23:34.557: FAIL: Unexpected error: <*errors.StatusError | 0xc00154e0a0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc00239a180) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc00239a180) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc00239a180, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:23:34.759: INFO: Deleting all statefulset in ns statefulset-8613 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-8613". �[1mSTEP�[0m: Found 0 events. Oct 24 20:23:35.595: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:23:35.595: INFO: Oct 24 20:23:35.730: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:23:35.897: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 9968 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:35.897: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:23:36.002: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:23:36.200: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:36.200: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:36.200: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:36.200: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:36.200: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:23:36.200: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:36.200: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:23:36.200: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:36.200: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:23:36.200: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:36.200: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:23:36.200: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:36.200: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:23:36.200: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:36.200: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:23:36.200: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:36.200: INFO: Container l7-lb-controller ready: true, restart count 2 W1024 20:23:36.372149 16712 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:36.863: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:23:36.863: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:36.967: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 20437 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:23:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:36.967: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:37.094: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:37.345: INFO: deployment-f2b3c2ad-a7cb-48fb-824f-55124fe135e4-7c79bb594d8mwpx started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:23:37.345: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container csi-snapshotter ready: false, restart count 0 Oct 24 20:23:37.345: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:23:37.345: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:23:37.345: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container coredns ready: true, restart count 0 Oct 24 20:23:37.345: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:37.345: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:23:37.345: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:23:37.345: INFO: pod-0b6baf03-c4cf-4b6b-9595-7eb39e2d48bc started at 2020-10-24 20:23:19 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:23:37.345: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-xk5df started at 2020-10-24 20:23:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:37.345: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-ftxkv started at 2020-10-24 20:23:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:37.345: INFO: rs-qqlnp started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:37.345: INFO: pod-d1396546-4144-4dd7-8cec-8b41803c2a9e started at 2020-10-24 20:23:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:23:37.345: INFO: pod-subpath-test-preprovisionedpv-sqrn started at <nil> (0+0 container statuses recorded) Oct 24 20:23:37.345: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:37.345: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:37.345: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:37.345: INFO: rs-w996f started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:37.345: INFO: csi-mockplugin-0 started at 2020-10-24 20:23:24 +0000 UTC (0+3 container statuses recorded) Oct 24 20:23:37.345: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:23:37.345: INFO: Container driver-registrar ready: false, restart count 0 Oct 24 20:23:37.345: INFO: Container mock ready: false, restart count 0 Oct 24 20:23:37.345: INFO: pvc-volume-tester-bfsh7 started at <nil> (0+0 container statuses recorded) Oct 24 20:23:37.345: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:21:19 +0000 UTC (0+3 container statuses recorded) Oct 24 20:23:37.345: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:23:37.345: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:23:37.345: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:23:37.345: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:23:37.345: INFO: rs-48dtp started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:37.345: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-nq7m4 started at <nil> (0+0 container statuses recorded) Oct 24 20:23:37.345: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:23:37.345: INFO: frontend-7659f66489-swgfc started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container guestbook-frontend ready: true, restart count 0 Oct 24 20:23:37.345: INFO: agnhost-replica-55fd9c5577-66h5p started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container replica ready: true, restart count 0 Oct 24 20:23:37.345: INFO: netserver-0 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container webserver ready: false, restart count 0 Oct 24 20:23:37.345: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:23:24 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:23:37.345: INFO: agnhost-primary-zwcf5 started at 2020-10-24 20:23:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container agnhost-primary ready: true, restart count 0 Oct 24 20:23:37.345: INFO: rs-lnf8g started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:37.345: INFO: Container donothing ready: true, restart count 0 W1024 20:23:37.445337 16712 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:38.422: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:38.422: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:38.647: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 20342 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:23:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:29 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:29 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:29 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:29 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:38.647: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:38.847: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:39.252: INFO: frontend-7659f66489-k4799 started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container guestbook-frontend ready: true, restart count 0 Oct 24 20:23:39.252: INFO: gluster-server started at 2020-10-24 20:22:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:23:39.252: INFO: svc-latency-rc-vxc7m started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container svc-latency-rc ready: true, restart count 0 Oct 24 20:23:39.252: INFO: rs-tg2kg started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:39.252: INFO: exec-volume-test-preprovisionedpv-wt5t started at 2020-10-24 20:23:36 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container exec-container-preprovisionedpv-wt5t ready: false, restart count 0 Oct 24 20:23:39.252: INFO: hostpath-symlink-prep-provisioning-4308 started at 2020-10-24 20:23:38 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container init-volume-provisioning-4308 ready: false, restart count 0 Oct 24 20:23:39.252: INFO: agnhost-primary-56857545d9-qrtps started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container primary ready: true, restart count 0 Oct 24 20:23:39.252: INFO: agnhost-replica-55fd9c5577-g8b95 started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container replica ready: true, restart count 0 Oct 24 20:23:39.252: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:23:39.252: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container coredns ready: true, restart count 0 Oct 24 20:23:39.252: INFO: netserver-1 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container webserver ready: false, restart count 0 Oct 24 20:23:39.252: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:39.252: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:39.252: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:39.252: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:23:39.252: INFO: rs-4d5fv started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:39.252: INFO: pod-1 started at 2020-10-24 20:23:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:39.252: INFO: rs-s4n84 started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:39.252: INFO: hostpath-client started at <nil> (0+0 container statuses recorded) Oct 24 20:23:39.252: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-4b797 started at 2020-10-24 20:23:12 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:39.252: INFO: gluster-server started at 2020-10-24 20:22:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:23:39.252: INFO: csi-mockplugin-0 started at 2020-10-24 20:22:57 +0000 UTC (0+3 container statuses recorded) Oct 24 20:23:39.252: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:23:39.252: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:23:39.252: INFO: Container mock ready: true, restart count 0 Oct 24 20:23:39.252: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:22:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:23:39.252: INFO: external-provisioner-n9587 started at 2020-10-24 20:21:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:39.252: INFO: Container nfs-provisioner ready: false, restart count 0 W1024 20:23:39.458327 16712 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:40.447: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:40.447: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:40.627: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 20296 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:23:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:40.627: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:40.778: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:40.977: INFO: projected-volume-9b85b5bd-287c-495f-8a60-63777f8219bc started at <nil> (0+0 container statuses recorded) Oct 24 20:23:40.977: INFO: rs-9t8bj started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:40.977: INFO: image-pull-teste0ffa64b-5d81-451d-910a-355476ee9583 started at <nil> (0+0 container statuses recorded) Oct 24 20:23:40.977: INFO: frontend-7659f66489-4dknw started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container guestbook-frontend ready: true, restart count 0 Oct 24 20:23:40.977: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:23:40.977: INFO: netserver-2 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container webserver ready: false, restart count 0 Oct 24 20:23:40.977: INFO: external-provisioner-6d5xq started at 2020-10-24 20:22:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:23:40.977: INFO: external-provisioner-gxznn started at 2020-10-24 20:23:35 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:23:40.977: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:40.977: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:40.977: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:40.977: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:23:40.977: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:23:40.977: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-rmzgn started at 2020-10-24 20:23:25 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:40.977: INFO: rs-4nnr8 started at 2020-10-24 20:23:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:40.977: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:23:40.977: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:23:40.977: INFO: test-runtimeclass-runtimeclass-5107-unconfigured-handler-zx49k started at 2020-10-24 20:23:36 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container test ready: false, restart count 0 Oct 24 20:23:40.977: INFO: rs-zsndw started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:40.977: INFO: gcepd-injector started at 2020-10-24 20:23:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:40.977: INFO: Container gcepd-injector ready: false, restart count 0 W1024 20:23:41.238172 16712 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:42.060: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:42.060: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-8613" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sperform\srolling\supdates\sand\sroll\sbacks\sof\stemplate\smodifications\swith\sPVCs$'
test/e2e/apps/statefulset.go:103 Oct 24 20:28:14.876: Unexpected error: <*errors.StatusError | 0xc0012b3680>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_02.xml
[BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:28:14.196: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-3557 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-3557 Oct 24 20:28:14.876: FAIL: Unexpected error: <*errors.StatusError | 0xc0012b3680>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002868180) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002868180) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002868180, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:28:15.009: INFO: Deleting all statefulset in ns statefulset-3557 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-3557". �[1mSTEP�[0m: Found 0 events. Oct 24 20:28:15.272: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:28:15.272: INFO: Oct 24 20:28:15.322: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:28:15.363: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 21291 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:28:15.363: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:28:15.410: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:28:15.470: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:15.470: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:28:15.470: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:15.470: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:28:15.470: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:15.470: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:28:15.470: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:28:15.470: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:28:15.470: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:28:15.470: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:15.470: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:28:15.470: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:15.470: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:28:15.470: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:15.470: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:28:15.470: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:15.470: INFO: Container etcd-container ready: true, restart count 0 W1024 20:28:15.547363 16609 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:28:15.847: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:28:15.847: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:28:15.894: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 33416 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4306":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-3917":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-5994":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-5360":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-261":"csi-mock-csi-mock-volumes-261","csi-mock-csi-mock-volumes-7525":"csi-mock-csi-mock-volumes-7525","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:27:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:28:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:28:11 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:2002029,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3917^673561c1-1637-11eb-a6bb-724b7d8fa050],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3917^673561c1-1637-11eb-a6bb-724b7d8fa050,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:28:15.894: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:28:15.957: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-kwcbx started at 2020-10-24 20:26:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:28:16.114: INFO: hostpath-injector started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-6dplp started at 2020-10-24 20:27:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:28:16.114: INFO: webserver-deployment-dd94f59b7-rtzdd started at 2020-10-24 20:27:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container httpd ready: true, restart count 0 Oct 24 20:28:16.114: INFO: webserver-deployment-dd94f59b7-54qkv started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: webserver-deployment-795d758f88-85rgz started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: webserver-deployment-dd94f59b7-dp7tm started at 2020-10-24 20:28:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container httpd ready: false, restart count 0 Oct 24 20:28:16.114: INFO: webserver-deployment-dd94f59b7-c29db started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: webserver-deployment-dd94f59b7-92sx6 started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:27:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:28:16.114: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:28:16.114: INFO: pod-cf638ebe-5209-4ebf-884d-1858ba8a2873 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:28:16.114: INFO: pod-b3a21af5-9183-4d26-9423-aa0705008bfa started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:28:16.114: INFO: pod-d5a4b2f2-b23d-4a05-a974-a7c671ef3c1b started at 2020-10-24 20:27:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:28:16.114: INFO: pod-subpath-test-inlinevolume-2q7q started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: test-webserver-a5a6615a-5119-487d-b311-a86326747f28 started at 2020-10-24 20:27:44 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container test-webserver ready: false, restart count 0 Oct 24 20:28:16.114: INFO: pod-b0144a94-2428-4eaf-bbda-1f60d4304534 started at 2020-10-24 20:28:02 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:28:16.114: INFO: pod-84fdf76d-d25e-41da-8934-bd2b6674cf52 started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:28:16.114: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container coredns ready: true, restart count 0 Oct 24 20:28:16.114: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:28:16.114: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:28:16.114: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-xmssk started at 2020-10-24 20:27:39 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-9wq8h started at 2020-10-24 20:26:38 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:28:16.114: INFO: netserver-0 started at 2020-10-24 20:27:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container webserver ready: true, restart count 0 Oct 24 20:28:16.114: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:28:16.114: INFO: local-client started at 2020-10-24 20:27:04 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container local-client ready: false, restart count 0 Oct 24 20:28:16.114: INFO: gluster-server started at 2020-10-24 20:26:23 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:28:16.114: INFO: webserver-deployment-dd94f59b7-slmfb started at 2020-10-24 20:27:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container httpd ready: true, restart count 0 Oct 24 20:28:16.114: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:28:16.114: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:28:16.114: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:28:16.114: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:27:51 +0000 UTC (0+3 container statuses recorded) Oct 24 20:28:16.114: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:28:16.114: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:28:16.114: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:28:16.114: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:28:16.114: INFO: webserver-deployment-795d758f88-7zhk4 started at 2020-10-24 20:28:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container httpd ready: false, restart count 0 Oct 24 20:28:16.114: INFO: pod-subpath-test-preprovisionedpv-5l79 started at 2020-10-24 20:27:05 +0000 UTC (0+2 container statuses recorded) Oct 24 20:28:16.114: INFO: Container test-container-subpath-preprovisionedpv-5l79 ready: false, restart count 0 Oct 24 20:28:16.114: INFO: Container test-container-volume-preprovisionedpv-5l79 ready: false, restart count 0 Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-5j4v9 started at 2020-10-24 20:27:44 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:28:16.114: INFO: webserver-deployment-795d758f88-kkdrb started at 2020-10-24 20:28:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container httpd ready: false, restart count 0 Oct 24 20:28:16.114: INFO: netserver-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: pod-ac66841d-8750-44ae-8e49-0689819b3bf3 started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:28:16.114: INFO: rs-j66mw started at 2020-10-24 20:27:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container donothing ready: false, restart count 0 Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-scvpk started at 2020-10-24 20:27:48 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:16.114: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-z85lj started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-7hqjx started at <nil> (0+0 container statuses recorded) Oct 24 20:28:16.114: INFO: webserver-deployment-795d758f88-bsnwh started at <nil> (0+0 container statuses recorded) W1024 20:28:16.164368 16609 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:28:20.919: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:28:20.919: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:28:20.972: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 33472 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-volume-expand-199":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-1202":"csi-mock-csi-mock-volumes-1202","csi-mock-csi-mock-volumes-167":"csi-mock-csi-mock-volumes-167","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-8443":"csi-mock-csi-mock-volumes-8443","csi-mock-csi-mock-volumes-9175":"csi-mock-csi-mock-volumes-9175","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:28:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:28:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:io.kubernetes.storage.mock/node":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:28:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:12 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:12 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:12 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:28:12 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-8443^4 kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-871d2d9c-56b6-4ab9-979a-6c52bb8420b9],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-871d2d9c-56b6-4ab9-979a-6c52bb8420b9,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-871d2d9c-56b6-4ab9-979a-6c52bb8420b9,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-8443^4,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:28:20.972: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:28:21.036: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:28:21.168: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:28:21.168: INFO: busybox-2909d4f8-e859-4c4d-bfb0-40d3844685ba started at 2020-10-24 20:24:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container busybox ready: true, restart count 0 Oct 24 20:28:21.168: INFO: exec-volume-test-dynamicpv-2fsp started at 2020-10-24 20:28:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container exec-container-dynamicpv-2fsp ready: false, restart count 0 Oct 24 20:28:21.168: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:28:21.168: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:28:21.168: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:28:21.168: INFO: pod-subpath-test-inlinevolume-w9g8 started at <nil> (0+0 container statuses recorded) Oct 24 20:28:21.168: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:27:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:28:21.168: INFO: netserver-1 started at 2020-10-24 20:27:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container webserver ready: true, restart count 0 Oct 24 20:28:21.168: INFO: pvc-volume-tester-w6kcg started at 2020-10-24 20:28:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container volume-tester ready: false, restart count 0 Oct 24 20:28:21.168: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:25:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:28:21.168: INFO: external-provisioner-kp8k5 started at 2020-10-24 20:27:03 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container nfs-provisioner ready: false, restart count 0 Oct 24 20:28:21.168: INFO: startup-e24d5ade-994a-49ec-b10c-e9b2f680220e started at 2020-10-24 20:26:32 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container busybox ready: false, restart count 0 Oct 24 20:28:21.168: INFO: failure-2 started at 2020-10-24 20:26:44 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container failure-2 ready: true, restart count 1 Oct 24 20:28:21.168: INFO: failed-jobs-history-limit-1603571280-ngtr5 started at 2020-10-24 20:28:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container c ready: false, restart count 1 Oct 24 20:28:21.168: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-8lq5n started at <nil> (0+0 container statuses recorded) Oct 24 20:28:21.168: INFO: netserver-1 started at 2020-10-24 20:28:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container webserver ready: false, restart count 0 Oct 24 20:28:21.168: INFO: failure-3 started at 2020-10-24 20:27:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container failure-3 ready: true, restart count 1 Oct 24 20:28:21.168: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container coredns ready: true, restart count 0 Oct 24 20:28:21.168: INFO: failure-1 started at 2020-10-24 20:26:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container failure-1 ready: false, restart count 0 Oct 24 20:28:21.168: INFO: pvc-tester-bkpkt started at 2020-10-24 20:27:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container write-pod ready: false, restart count 0 Oct 24 20:28:21.168: INFO: csi-mockplugin-0 started at 2020-10-24 20:27:56 +0000 UTC (0+3 container statuses recorded) Oct 24 20:28:21.168: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:28:21.168: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:28:21.168: INFO: Container mock ready: true, restart count 0 Oct 24 20:28:21.168: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:21.168: INFO: Container kube-proxy ready: true, restart count 0 W1024 20:28:21.224164 16609 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:28:22.233: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:28:22.233: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:28:22.276: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 33289 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-4858":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-6603":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-7825":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-701":"csi-mock-csi-mock-volumes-701","csi-mock-csi-mock-volumes-8880":"csi-mock-csi-mock-volumes-8880","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:27:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:27:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:28:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:27:41 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:27:41 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:27:41 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:27:41 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:28:22.276: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:28:22.335: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:28:22.424: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:27:20 +0000 UTC (0+3 container statuses recorded) Oct 24 20:28:22.424: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:28:22.424: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:28:22.424: INFO: Container node-driver-registrar ready: false, restart count 0 Oct 24 20:28:22.424: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:28:22.424: INFO: netserver-2 started at 2020-10-24 20:27:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container webserver ready: true, restart count 0 Oct 24 20:28:22.424: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:28:22.424: INFO: pvc-volume-tester-qj54c started at 2020-10-24 20:26:24 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container volume-tester ready: false, restart count 0 Oct 24 20:28:22.424: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:28:22.424: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:28:22.424: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:28:22.424: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:28:22.424: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:26:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:28:22.424: INFO: test-container-pod started at 2020-10-24 20:28:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container webserver ready: true, restart count 0 Oct 24 20:28:22.424: INFO: affinity-clusterip-t6lpm started at 2020-10-24 20:27:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container affinity-clusterip ready: false, restart count 0 Oct 24 20:28:22.424: INFO: busybox-readonly-fsd93d6604-a5c8-4642-9324-548d5a2b6efe started at 2020-10-24 20:28:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container busybox-readonly-fsd93d6604-a5c8-4642-9324-548d5a2b6efe ready: true, restart count 0 Oct 24 20:28:22.424: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:27:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:28:22.424: INFO: success started at 2020-10-24 20:26:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container success ready: false, restart count 0 Oct 24 20:28:22.424: INFO: netserver-2 started at 2020-10-24 20:28:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container webserver ready: false, restart count 0 Oct 24 20:28:22.424: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:28:22.424: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:28:22.424: INFO: csi-mockplugin-0 started at 2020-10-24 20:26:15 +0000 UTC (0+3 container statuses recorded) Oct 24 20:28:22.424: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:28:22.424: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:28:22.424: INFO: Container mock ready: true, restart count 0 Oct 24 20:28:22.424: INFO: implicit-nonroot-uid started at <nil> (0+0 container statuses recorded) Oct 24 20:28:22.424: INFO: httpd started at 2020-10-24 20:25:47 +0000 UTC (0+1 container statuses recorded) Oct 24 20:28:22.424: INFO: Container httpd ready: true, restart count 0 Oct 24 20:28:22.424: INFO: pfpod started at 2020-10-24 20:27:11 +0000 UTC (0+2 container statuses recorded) Oct 24 20:28:22.424: INFO: Container portforwardtester ready: false, restart count 0 Oct 24 20:28:22.424: INFO: Container readiness ready: false, restart count 0 W1024 20:28:22.507085 16609 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:28:23.663: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:28:23.663: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-3557" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-apps\]\sStatefulSet\s\[k8s\.io\]\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sprovide\sbasic\sidentity$'
test/e2e/apps/statefulset.go:103 Oct 24 20:24:53.940: Unexpected error: <*errors.StatusError | 0xc000cf6f00>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/apps/statefulset.go:111from junit_28.xml
[BeforeEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:24:53.178: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename statefulset �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in statefulset-6005 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [BeforeEach] [sig-apps] StatefulSet test/e2e/apps/statefulset.go:88 [BeforeEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:103 �[1mSTEP�[0m: Creating service test in namespace statefulset-6005 Oct 24 20:24:53.940: FAIL: Unexpected error: <*errors.StatusError | 0xc000cf6f00>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"test\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "test", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "test" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func10.2.1() test/e2e/apps/statefulset.go:111 +0x48d k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a62600) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a62600) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc001a62600, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [k8s.io] Basic StatefulSet functionality [StatefulSetBasic] test/e2e/apps/statefulset.go:114 Oct 24 20:24:54.028: INFO: Deleting all statefulset in ns statefulset-6005 [AfterEach] [sig-apps] StatefulSet test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "statefulset-6005". �[1mSTEP�[0m: Found 0 events. Oct 24 20:24:54.366: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:24:54.366: INFO: Oct 24 20:24:54.446: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:24:54.596: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 21291 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:44 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:54.597: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:24:54.752: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:24:54.878: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:54.878: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:54.878: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:24:54.878: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:54.878: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:24:54.878: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:54.878: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:24:54.878: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:54.878: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:24:54.878: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:54.878: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:24:54.878: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:54.878: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:24:54.878: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:54.878: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:24:54.878: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:54.878: INFO: Container l7-lb-controller ready: true, restart count 2 W1024 20:24:54.982875 16848 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:24:55.346: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:24:55.346: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:55.433: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 24116 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4306":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-5994":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-5360":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-261":"csi-mock-csi-mock-volumes-261","csi-mock-csi-mock-volumes-7525":"csi-mock-csi-mock-volumes-7525","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kubelet Update v1 2020-10-24 20:24:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:24:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:24:09 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:55.433: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:55.542: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:55.713: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-7kvjz started at 2020-10-24 20:24:35 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:55.713: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-xdhzj started at <nil> (0+0 container statuses recorded) Oct 24 20:24:55.713: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-mockplugin-0 started at 2020-10-24 20:23:24 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:55.713: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:24:55.713: INFO: Container mock ready: true, restart count 0 Oct 24 20:24:55.713: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:55.713: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:55.713: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-mockplugin-0 started at 2020-10-24 20:23:58 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:55.713: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:24:55.713: INFO: Container mock ready: true, restart count 0 Oct 24 20:24:55.713: INFO: pvc-volume-tester-r48pv started at 2020-10-24 20:24:33 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container volume-tester ready: true, restart count 0 Oct 24 20:24:55.713: INFO: pod-164d0df7-d8d5-4cdb-8971-72012f6f65ae started at 2020-10-24 20:24:42 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:08 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:55.713: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:24:55.713: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:24:55.713: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:24:10 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:24:55.713: INFO: inline-volume-tester-zxlzn started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-volume-tester ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:24:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:24:55.713: INFO: pod-b5145b05-0540-4ecf-afc5-46ae929a5ab8 started at <nil> (0+0 container statuses recorded) Oct 24 20:24:55.713: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:55.713: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-4khks started at 2020-10-24 20:24:44 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.713: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:55.713: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:31 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:55.714: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-6b6n6 started at 2020-10-24 20:24:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:55.714: INFO: netserver-0 started at 2020-10-24 20:24:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container webserver ready: false, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:28 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:55.714: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:24:55.714: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:24:55.714: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:28 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:55.714: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:24:55.714: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:24:55.714: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:24:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:24:55.714: INFO: netserver-0 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:23:24 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:24:55.714: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container coredns ready: true, restart count 0 Oct 24 20:24:55.714: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:55.714: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:24:55.714: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:24:55.714: INFO: netserver-0 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-mockplugin-resizer-0 started at 2020-10-24 20:23:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:24:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:24:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-mockplugin-0 started at 2020-10-24 20:24:24 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:55.714: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:24:55.714: INFO: Container mock ready: true, restart count 0 Oct 24 20:24:55.714: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:24:30 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:24:55.714: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:24:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:55.714: INFO: Container csi-resizer ready: true, restart count 0 W1024 20:24:55.785193 16848 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:24:56.854: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:24:56.854: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:57.036: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 23371 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:24:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:30 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:30 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:30 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:24:30 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:57.037: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:57.166: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:57.394: INFO: test-webserver-880fc7db-0c4f-4dc5-8a7e-da95a2a1d260 started at 2020-10-24 20:24:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container test-webserver ready: false, restart count 0 Oct 24 20:24:57.394: INFO: pod-init-132337a1-4e3b-43a2-bddd-b296353fd12b started at 2020-10-24 20:24:40 +0000 UTC (2+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Init container init1 ready: true, restart count 0 Oct 24 20:24:57.394: INFO: Init container init2 ready: true, restart count 0 Oct 24 20:24:57.394: INFO: Container run1 ready: false, restart count 0 Oct 24 20:24:57.394: INFO: webserver-dd94f59b7-k26g4 started at 2020-10-24 20:24:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container httpd ready: true, restart count 0 Oct 24 20:24:57.394: INFO: test-container-pod started at 2020-10-24 20:24:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:57.394: INFO: netserver-1 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:57.394: INFO: webserver-dd94f59b7-vlxls started at 2020-10-24 20:24:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container httpd ready: false, restart count 0 Oct 24 20:24:57.394: INFO: nfs-server started at 2020-10-24 20:24:48 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container nfs-server ready: true, restart count 0 Oct 24 20:24:57.394: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:24:57.394: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container coredns ready: true, restart count 0 Oct 24 20:24:57.394: INFO: netserver-1 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:57.394: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-xxdq7 started at 2020-10-24 20:23:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:57.394: INFO: busybox-2909d4f8-e859-4c4d-bfb0-40d3844685ba started at 2020-10-24 20:24:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container busybox ready: true, restart count 0 Oct 24 20:24:57.394: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:57.394: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:57.394: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:24:57.394: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:24:57.394: INFO: netserver-1 started at 2020-10-24 20:24:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container webserver ready: false, restart count 0 Oct 24 20:24:57.394: INFO: webserver-dd94f59b7-d7smf started at 2020-10-24 20:24:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container httpd ready: false, restart count 0 Oct 24 20:24:57.394: INFO: pod-configmaps-59b74d1f-f3a7-4c5e-a825-72f9af63a7d1 started at 2020-10-24 20:24:40 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:57.394: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Oct 24 20:24:57.394: INFO: Container configmap-volume-data-test ready: true, restart count 0 Oct 24 20:24:57.394: INFO: concurrent-1603571040-c4785 started at 2020-10-24 20:24:02 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container c ready: false, restart count 0 Oct 24 20:24:57.394: INFO: termination-message-container5a69110b-8805-46ef-9cc0-7d8a56a3c897 started at 2020-10-24 20:24:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container termination-message-container ready: false, restart count 0 Oct 24 20:24:57.394: INFO: dns-test-235ee51f-1bc4-4588-abfe-04f2ff153eab started at <nil> (0+0 container statuses recorded) Oct 24 20:24:57.394: INFO: webserver-dd94f59b7-r9r9k started at 2020-10-24 20:24:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container httpd ready: false, restart count 0 Oct 24 20:24:57.394: INFO: webserver-dd94f59b7-rbm7g started at 2020-10-24 20:24:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:57.394: INFO: Container httpd ready: false, restart count 0 W1024 20:24:57.550677 16848 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:24:58.218: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:24:58.218: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:24:58.280: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 24316 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-6603":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:24:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:24:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:49 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:49 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:24:49 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:24:49 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0],SizeBytes:85425365,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-6603^eb3d39ff-1636-11eb-84dd-ba508e270e23],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-6603^eb3d39ff-1636-11eb-84dd-ba508e270e23,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:24:58.280: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:24:58.357: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:24:58.546: INFO: webserver-dd94f59b7-lwshf started at 2020-10-24 20:24:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container httpd ready: true, restart count 0 Oct 24 20:24:58.546: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-gxwnf started at 2020-10-24 20:24:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:24:58.546: INFO: netserver-2 started at 2020-10-24 20:23:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:58.546: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:24:23 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:58.546: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:24:58.546: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:24:58.546: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:24:58.546: INFO: pod-secrets-5ce623d7-1040-4ea6-bcaa-7ec3f1251450 started at 2020-10-24 20:24:19 +0000 UTC (0+3 container statuses recorded) Oct 24 20:24:58.546: INFO: Container creates-volume-test ready: true, restart count 0 Oct 24 20:24:58.546: INFO: Container dels-volume-test ready: true, restart count 0 Oct 24 20:24:58.546: INFO: Container upds-volume-test ready: true, restart count 0 Oct 24 20:24:58.546: INFO: successful-jobs-history-limit-1603571040-zzvfr started at 2020-10-24 20:24:03 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container c ready: false, restart count 0 Oct 24 20:24:58.546: INFO: pod-subpath-test-dynamicpv-gkp5 started at 2020-10-24 20:24:32 +0000 UTC (2+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Init container init-volume-dynamicpv-gkp5 ready: true, restart count 0 Oct 24 20:24:58.546: INFO: Init container test-init-volume-dynamicpv-gkp5 ready: true, restart count 0 Oct 24 20:24:58.546: INFO: Container test-container-subpath-dynamicpv-gkp5 ready: false, restart count 0 Oct 24 20:24:58.546: INFO: fail-once-local-2fl2c started at <nil> (0+0 container statuses recorded) Oct 24 20:24:58.546: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:24:58.546: INFO: netserver-2 started at 2020-10-24 20:23:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:58.546: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:24:58.546: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:24:58.546: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:24:58.546: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:24:58.546: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:24:58.546: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:24:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:24:58.546: INFO: startup-eb3b4e82-6f73-4e77-a322-36124c06e6b9 started at 2020-10-24 20:24:18 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container busybox ready: false, restart count 0 Oct 24 20:24:58.546: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:24:28 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:24:58.546: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:24:58.546: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:24:58.546: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:24:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:24:58.546: INFO: netserver-2 started at 2020-10-24 20:24:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:58.546: INFO: test-container-pod started at 2020-10-24 20:23:51 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container webserver ready: true, restart count 0 Oct 24 20:24:58.546: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:24:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:24:58.546: INFO: Container csi-resizer ready: true, restart count 0 W1024 20:24:58.622028 16848 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:25:00.802: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:25:00.802: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "statefulset-6005" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\spods\sfor\sHostname\s\[LinuxOnly\]\s\[Conformance\]$'
test/e2e/framework/framework.go:629 Oct 24 20:23:23.854: failed to create headless service: dns-test-service-2 Unexpected error: <*errors.StatusError | 0xc0009a2640>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"dns-test-service-2\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "dns-test-service-2", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "dns-test-service-2" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/network/dns.go:255from junit_22.xml
[BeforeEach] [sig-network] DNS test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:23:22.987: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename dns �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in dns-2776 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for pods for Hostname [LinuxOnly] [Conformance] test/e2e/framework/framework.go:629 �[1mSTEP�[0m: Creating a test headless service Oct 24 20:23:23.854: FAIL: failed to create headless service: dns-test-service-2 Unexpected error: <*errors.StatusError | 0xc0009a2640>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"dns-test-service-2\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "dns-test-service-2", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "dns-test-service-2" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func2.7() test/e2e/network/dns.go:255 +0x350 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002362180) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002362180) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002362180, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [sig-network] DNS test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "dns-2776". �[1mSTEP�[0m: Found 0 events. Oct 24 20:23:24.071: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:23:24.071: INFO: Oct 24 20:23:24.137: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:23:24.229: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 9968 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:24.230: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:23:24.478: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:23:24.626: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:24.626: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:23:24.626: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:24.626: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:23:24.626: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:24.626: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:23:24.626: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:24.626: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:23:24.626: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:24.626: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:23:24.626: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:24.626: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:23:24.626: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:24.626: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:24.626: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:24.626: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:24.626: INFO: Container kube-controller-manager ready: true, restart count 0 W1024 20:23:24.730120 16830 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:25.176: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:23:25.176: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:25.274: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 19828 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kubelet Update v1 2020-10-24 20:23:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:01 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:18 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-46d754ab-b581-4481-8fa4-ffc6fbfc84a3,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:25.276: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:25.346: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:25.474: INFO: csi-mockplugin-attacher-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:23:25.475: INFO: agnhost-primary-zwcf5 started at 2020-10-24 20:23:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container agnhost-primary ready: true, restart count 0 Oct 24 20:23:25.475: INFO: rs-lnf8g started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container donothing ready: false, restart count 0 Oct 24 20:23:25.475: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:23:25.475: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container coredns ready: true, restart count 0 Oct 24 20:23:25.475: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:25.475: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:23:25.475: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:23:25.475: INFO: deployment-f2b3c2ad-a7cb-48fb-824f-55124fe135e4-7c79bb594d8mwpx started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container write-pod ready: false, restart count 0 Oct 24 20:23:25.475: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:23:25.475: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:23:25.475: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-xk5df started at 2020-10-24 20:23:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:25.475: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-ftxkv started at 2020-10-24 20:23:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:25.475: INFO: rs-qqlnp started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container donothing ready: false, restart count 0 Oct 24 20:23:25.475: INFO: pod-0b6baf03-c4cf-4b6b-9595-7eb39e2d48bc started at <nil> (0+0 container statuses recorded) Oct 24 20:23:25.475: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:25.475: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:25.475: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:25.475: INFO: rs-w996f started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container donothing ready: false, restart count 0 Oct 24 20:23:25.475: INFO: csi-mockplugin-0 started at <nil> (0+0 container statuses recorded) Oct 24 20:23:25.475: INFO: pfpod started at 2020-10-24 20:23:12 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container pause ready: true, restart count 0 Oct 24 20:23:25.475: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:23:25.475: INFO: httpd started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container httpd ready: false, restart count 0 Oct 24 20:23:25.475: INFO: rs-48dtp started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container donothing ready: false, restart count 0 Oct 24 20:23:25.475: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:21:19 +0000 UTC (0+3 container statuses recorded) Oct 24 20:23:25.475: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:23:25.475: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:23:25.475: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:23:25.475: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:23:25.475: INFO: frontend-7659f66489-swgfc started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container guestbook-frontend ready: true, restart count 0 Oct 24 20:23:25.475: INFO: agnhost-replica-55fd9c5577-66h5p started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container replica ready: true, restart count 0 Oct 24 20:23:25.475: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:21:21 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:25.475: INFO: Container csi-attacher ready: true, restart count 0 W1024 20:23:25.548914 16830 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:27.771: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:23:27.771: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:27.900: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 19313 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402","csi-mock-csi-mock-volumes-9561":"csi-mock-csi-mock-volumes-9561"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:23:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:23:03 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:08 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:08 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:08 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:08 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[docker.io/gluster/glusterdynamic-provisioner@sha256:90067cb05a7d217651e84576935934fd9dcff8e6bcdcbaa416bbf36fcd09dbd1 docker.io/gluster/glusterdynamic-provisioner:v1.0],SizeBytes:111200078,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-9561^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9561^4,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:27.900: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:28.070: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:28.381: INFO: hostpath-injector started at 2020-10-24 20:23:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container hostpath-injector ready: false, restart count 0 Oct 24 20:23:28.381: INFO: gluster-server started at 2020-10-24 20:22:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:23:28.381: INFO: csi-mockplugin-0 started at 2020-10-24 20:22:57 +0000 UTC (0+3 container statuses recorded) Oct 24 20:23:28.381: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:23:28.381: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:23:28.381: INFO: Container mock ready: true, restart count 0 Oct 24 20:23:28.381: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:22:57 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:23:28.381: INFO: external-provisioner-n9587 started at 2020-10-24 20:21:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container nfs-provisioner ready: false, restart count 0 Oct 24 20:23:28.381: INFO: pod-subpath-test-inlinevolume-6p9l started at 2020-10-24 20:23:25 +0000 UTC (2+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Init container init-volume-inlinevolume-6p9l ready: true, restart count 0 Oct 24 20:23:28.381: INFO: Init container test-init-volume-inlinevolume-6p9l ready: true, restart count 0 Oct 24 20:23:28.381: INFO: Container test-container-subpath-inlinevolume-6p9l ready: false, restart count 0 Oct 24 20:23:28.381: INFO: frontend-7659f66489-k4799 started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container guestbook-frontend ready: true, restart count 0 Oct 24 20:23:28.381: INFO: gluster-server started at 2020-10-24 20:22:49 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container gluster-server ready: true, restart count 0 Oct 24 20:23:28.381: INFO: pod-subpath-test-preprovisionedpv-h65b started at 2020-10-24 20:23:04 +0000 UTC (1+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Init container init-volume-preprovisionedpv-h65b ready: true, restart count 0 Oct 24 20:23:28.381: INFO: Container test-container-subpath-preprovisionedpv-h65b ready: false, restart count 0 Oct 24 20:23:28.381: INFO: agnhost-primary-56857545d9-qrtps started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container primary ready: true, restart count 0 Oct 24 20:23:28.381: INFO: agnhost-replica-55fd9c5577-g8b95 started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container replica ready: true, restart count 0 Oct 24 20:23:28.381: INFO: rs-tg2kg started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:28.381: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:23:28.381: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container coredns ready: true, restart count 0 Oct 24 20:23:28.381: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:28.381: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:28.381: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:28.381: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:23:28.381: INFO: rs-4d5fv started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:28.381: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-vvqhw started at 2020-10-24 20:22:43 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:28.381: INFO: rs-s4n84 started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:28.381: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-4b797 started at 2020-10-24 20:23:12 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:28.381: INFO: Container agnhost-container ready: true, restart count 0 W1024 20:23:28.723217 16830 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:29.845: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:23:29.845: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:29.958: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 20296 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:23:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:23:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:23:08 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:23:07 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:23:27 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/gce-pd/e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840,DevicePath:/dev/disk/by-id/google-e2e-102521e575-a7d53-d-pvc-14433170-1ea4-48f0-af3c-16e642cc5840,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:23:29.958: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:30.054: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:30.201: INFO: rs-9t8bj started at 2020-10-24 20:23:14 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:30.201: INFO: nfs-server started at 2020-10-24 20:22:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container nfs-server ready: true, restart count 0 Oct 24 20:23:30.201: INFO: frontend-7659f66489-4dknw started at 2020-10-24 20:23:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container guestbook-frontend ready: true, restart count 0 Oct 24 20:23:30.201: INFO: nfs-server started at 2020-10-24 20:22:44 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container nfs-server ready: true, restart count 0 Oct 24 20:23:30.201: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:23:30.201: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Oct 24 20:23:30.201: INFO: external-provisioner-6d5xq started at 2020-10-24 20:22:40 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:23:30.201: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-flglz started at 2020-10-24 20:23:09 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:30.201: INFO: pod-subpath-test-preprovisionedpv-ks6d started at 2020-10-24 20:23:21 +0000 UTC (1+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Init container init-volume-preprovisionedpv-ks6d ready: false, restart count 0 Oct 24 20:23:30.201: INFO: Container test-container-subpath-preprovisionedpv-ks6d ready: false, restart count 0 Oct 24 20:23:30.201: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:23:30.201: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:30.201: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:23:30.201: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:23:30.201: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:23:30.201: INFO: rs-4q9cw started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:30.201: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-rmzgn started at 2020-10-24 20:23:25 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container agnhost-container ready: false, restart count 0 Oct 24 20:23:30.201: INFO: rs-4nnr8 started at <nil> (0+0 container statuses recorded) Oct 24 20:23:30.201: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:23:30.201: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:23:30.201: INFO: rs-zsndw started at 2020-10-24 20:23:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container donothing ready: true, restart count 0 Oct 24 20:23:30.201: INFO: gcepd-injector started at 2020-10-24 20:23:22 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container gcepd-injector ready: false, restart count 0 Oct 24 20:23:30.201: INFO: pod-host-path-test started at 2020-10-24 20:23:21 +0000 UTC (0+2 container statuses recorded) Oct 24 20:23:30.201: INFO: Container test-container-1 ready: false, restart count 0 Oct 24 20:23:30.201: INFO: Container test-container-2 ready: false, restart count 0 Oct 24 20:23:30.201: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-p4cft started at 2020-10-24 20:23:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:23:30.201: INFO: nfs-client started at 2020-10-24 20:23:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:23:30.201: INFO: Container nfs-client ready: true, restart count 0 W1024 20:23:30.300552 16830 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:23:31.022: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:23:31.022: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "dns-2776" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\spods\sfor\sSubdomain\s\[Conformance\]$'
test/e2e/framework/framework.go:629 Oct 24 20:22:28.427: failed to create headless service: dns-test-service-2 Unexpected error: <*errors.StatusError | 0xc000ba8be0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"dns-test-service-2\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "dns-test-service-2", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "dns-test-service-2" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/network/dns.go:297from junit_21.xml
[BeforeEach] [sig-network] DNS test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:22:27.882: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename dns �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in dns-5159 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for pods for Subdomain [Conformance] test/e2e/framework/framework.go:629 �[1mSTEP�[0m: Creating a test headless service Oct 24 20:22:28.427: FAIL: failed to create headless service: dns-test-service-2 Unexpected error: <*errors.StatusError | 0xc000ba8be0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"dns-test-service-2\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "dns-test-service-2", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "dns-test-service-2" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func2.8() test/e2e/network/dns.go:297 +0x350 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc001a32180) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc001a32180) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc001a32180, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [sig-network] DNS test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "dns-5159". �[1mSTEP�[0m: Found 0 events. Oct 24 20:22:28.554: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:22:28.554: INFO: Oct 24 20:22:28.619: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:22:28.689: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 9968 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:18:43 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:28.690: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:22:28.774: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:22:28.840: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:28.840: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:22:28.840: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:28.840: INFO: Container l7-lb-controller ready: true, restart count 2 Oct 24 20:22:28.840: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:28.840: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:28.840: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:28.840: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:28.840: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:22:28.840: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:28.840: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:22:28.840: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:28.840: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:22:28.840: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:28.840: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:22:28.840: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:28.840: INFO: Container kube-apiserver ready: true, restart count 0 W1024 20:22:28.949348 16793 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:29.287: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:22:29.287: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:29.364: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 18067 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:21:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:22:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:06 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:22:28 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:22:28 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:22:28 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:22:28 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:29.364: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:29.441: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:29.571: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:21:21 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.571: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container csi-snapshotter ready: false, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:21:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:22:29.572: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:22:29.572: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container coredns ready: true, restart count 0 Oct 24 20:22:29.572: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:29.572: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:22:29.572: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container csi-provisioner ready: false, restart count 0 Oct 24 20:22:29.572: INFO: gcepd-injector started at 2020-10-24 20:21:50 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container gcepd-injector ready: false, restart count 0 Oct 24 20:22:29.572: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:29.572: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:29.572: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container csi-resizer ready: false, restart count 0 Oct 24 20:22:29.572: INFO: all-pods-removed-pqs4f started at 2020-10-24 20:22:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container c ready: true, restart count 0 Oct 24 20:22:29.572: INFO: pod-client started at 2020-10-24 20:22:25 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container pod-client ready: true, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:21:19 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:29.572: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:22:29.572: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:22:29.572: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:22:29.572: INFO: hostpath-client started at 2020-10-24 20:22:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container hostpath-client ready: false, restart count 0 Oct 24 20:22:29.572: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:19:34 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:29.572: INFO: Container csi-attacher ready: false, restart count 0 Oct 24 20:22:29.572: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:19:32 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:29.572: INFO: Container hostpath ready: false, restart count 0 Oct 24 20:22:29.572: INFO: Container liveness-probe ready: false, restart count 0 Oct 24 20:22:29.572: INFO: Container node-driver-registrar ready: false, restart count 0 W1024 20:22:29.627990 16793 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:29.935: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:22:29.935: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:29.994: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 16704 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fgpg topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6111":"e2e-102521e575-a7d53-minion-group-fgpg","csi-hostpath-provisioning-5493":"e2e-102521e575-a7d53-minion-group-fgpg","csi-mock-csi-mock-volumes-4295":"csi-mock-csi-mock-volumes-4295","csi-mock-csi-mock-volumes-8123":"csi-mock-csi-mock-volumes-8123","csi-mock-csi-mock-volumes-8402":"csi-mock-csi-mock-volumes-8402"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:04 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:21:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:21:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fgpg,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:02 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:03 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:21:48 +0000 UTC,LastTransitionTime:2020-10-24 20:12:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.4,},NodeAddress{Type:ExternalIP,Address:35.233.176.12,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fgpg.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:484e0e9665542595fa3c5b08f0a4d4a5,SystemUUID:484e0e96-6554-2595-fa3c-5b08f0a4d4a5,BootID:96ed4ed0-65ff-4e0b-ad70-e4fde2ff3945,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:ff02aacd9766d597883fabafc7ad604c719a57611db1bcc1564c69a45b000a55 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.17],SizeBytes:25311280,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b k8s.gcr.io/busybox:1.27],SizeBytes:694360,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:29.996: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:30.050: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:30.099: INFO: pod-secrets-7d9c06c5-baec-41b7-8e5f-c67ed33d1224 started at 2020-10-24 20:22:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container secret-env-test ready: false, restart count 0 Oct 24 20:22:30.099: INFO: gluster-server started at 2020-10-24 20:20:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container gluster-server ready: false, restart count 0 Oct 24 20:22:30.099: INFO: pod-projected-configmaps-011cd241-1bae-4a2a-86e6-ee31741ab51a started at 2020-10-24 20:21:35 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:30.099: INFO: Container createcm-volume-test ready: true, restart count 0 Oct 24 20:22:30.099: INFO: Container delcm-volume-test ready: true, restart count 0 Oct 24 20:22:30.099: INFO: Container updcm-volume-test ready: true, restart count 0 Oct 24 20:22:30.099: INFO: pfpod started at 2020-10-24 20:22:10 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:30.099: INFO: Container portforwardtester ready: false, restart count 0 Oct 24 20:22:30.099: INFO: Container readiness ready: false, restart count 0 Oct 24 20:22:30.099: INFO: gluster-server started at 2020-10-24 20:22:12 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container gluster-server ready: true, restart count 0 Oct 24 20:22:30.099: INFO: concurrent-1603570860-4wtcs started at 2020-10-24 20:21:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container c ready: true, restart count 0 Oct 24 20:22:30.099: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-z49lw started at 2020-10-24 20:22:11 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:22:30.099: INFO: gluster-server started at 2020-10-24 20:22:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container gluster-server ready: true, restart count 0 Oct 24 20:22:30.099: INFO: pod-subpath-test-inlinevolume-67vv started at 2020-10-24 20:22:27 +0000 UTC (1+2 container statuses recorded) Oct 24 20:22:30.099: INFO: Init container test-init-subpath-inlinevolume-67vv ready: false, restart count 0 Oct 24 20:22:30.099: INFO: Container test-container-subpath-inlinevolume-67vv ready: false, restart count 0 Oct 24 20:22:30.099: INFO: Container test-container-volume-inlinevolume-67vv ready: false, restart count 0 Oct 24 20:22:30.099: INFO: pod-ephm-test-projected-dn22 started at 2020-10-24 20:22:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container test-container-subpath-projected-dn22 ready: false, restart count 0 Oct 24 20:22:30.099: INFO: external-provisioner-n9587 started at 2020-10-24 20:21:41 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:22:30.099: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fgpg-vwztx started at <nil> (0+0 container statuses recorded) Oct 24 20:22:30.099: INFO: concurrent-1603570920-7tbh5 started at 2020-10-24 20:22:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container c ready: true, restart count 0 Oct 24 20:22:30.099: INFO: glusterdynamic-provisioner-x8s9s started at 2020-10-24 20:22:12 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container glusterdynamic-provisioner ready: false, restart count 0 Oct 24 20:22:30.099: INFO: agnhost-primary-whj6g started at 2020-10-24 20:22:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container agnhost-primary ready: false, restart count 0 Oct 24 20:22:30.099: INFO: pod-submit-remove-7114c3d2-d790-4453-b358-54bc965b1106 started at 2020-10-24 20:22:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container agnhost-container ready: false, restart count 0 Oct 24 20:22:30.099: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fgpg started at 2020-10-24 20:12:46 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:22:30.099: INFO: coredns-6954c77b9b-5kdqw started at 2020-10-24 20:13:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container coredns ready: true, restart count 0 Oct 24 20:22:30.099: INFO: nfs-client started at 2020-10-24 20:22:06 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container nfs-client ready: true, restart count 0 Oct 24 20:22:30.099: INFO: pod-configmaps-e2fd15d7-7486-4786-94f4-44492abee464 started at 2020-10-24 20:21:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container configmap-volume-test ready: true, restart count 0 Oct 24 20:22:30.099: INFO: metadata-proxy-v0.1-jlr6t started at 2020-10-24 20:12:46 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:30.099: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:30.099: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:30.099: INFO: npd-v0.8.0-2ntfb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:22:30.099: INFO: pod-server-1 started at 2020-10-24 20:22:27 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:30.099: INFO: Container agnhost-container ready: false, restart count 0 W1024 20:22:30.170116 16793 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:31.037: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:22:31.037: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:31.115: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-svhc 610c32d5-1cca-48a5-8a5f-845fce8e2f67 16686 0 2020-10-24 20:12:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-svhc kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-svhc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3058":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-provisioning-9426":"e2e-102521e575-a7d53-minion-group-svhc","csi-hostpath-volume-2355":"e2e-102521e575-a7d53-minion-group-svhc","csi-mock-csi-mock-volumes-6505":"csi-mock-csi-mock-volumes-6505","csi-mock-csi-mock-volumes-9594":"csi-mock-csi-mock-volumes-9594","csi-mock-csi-mock-volumes-9914":"csi-mock-csi-mock-volumes-9914"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:14 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {kube-controller-manager Update v1 2020-10-24 20:18:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}} {kubelet Update v1 2020-10-24 20:21:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-svhc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819636736 0} {<nil>} 7636364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557492736 0} {<nil>} 7380364Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:18:15 +0000 UTC,LastTransitionTime:2020-10-24 20:13:13 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:13:05 +0000 UTC,LastTransitionTime:2020-10-24 20:13:05 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:12:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:21:47 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.235.100,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-svhc.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:3a98bc9342be556c8407a4a79bd9b1ca,SystemUUID:3a98bc93-42be-556c-8407-a4a79bd9b1ca,BootID:ca7cfadc-8d07-42a8-9b39-a42c81d14f11,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/sig-storage/nfs-provisioner@sha256:c1bedac8758029948afe060bf8f6ee63ea489b5e08d29745f44fab68ee0d46ca k8s.gcr.io/sig-storage/nfs-provisioner:v2.2.2],SizeBytes:138177747,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[docker.io/library/nginx@sha256:ed7f815851b5299f616220a63edac69a4cc200e7f536a56e421988da82e44ed8 docker.io/library/nginx:latest],SizeBytes:53593938,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[k8s.gcr.io/sig-storage/snapshot-controller@sha256:36ca32433c069246ea8988a7b3dbdf0aabf8345be9122b8a25426e6c487878de k8s.gcr.io/sig-storage/snapshot-controller:v3.0.0],SizeBytes:17462937,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/apparmor-loader@sha256:1fdc224b826c4bc16b3cdf5c09d6e5b8c7aa77e2b2d81472a1316bd1606fa1bd gcr.io/kubernetes-e2e-test-images/apparmor-loader:1.0],SizeBytes:6365390,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64@sha256:d83d8a481145d0eb71f8bd71ae236d1c6a931dd3bdcaf80919a8ec4a4d8aff74 k8s.gcr.io/ingress-gce-404-server-with-metrics-amd64:v1.6.0],SizeBytes:6362391,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:22:31.115: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:31.208: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:31.294: INFO: external-provisioner-8xk9l started at 2020-10-24 20:22:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container nfs-provisioner ready: true, restart count 0 Oct 24 20:22:31.294: INFO: npd-v0.8.0-pkz4p started at 2020-10-24 20:13:05 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:22:31.294: INFO: csi-mockplugin-0 started at 2020-10-24 20:21:00 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:31.294: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:22:31.294: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:22:31.294: INFO: Container mock ready: true, restart count 0 Oct 24 20:22:31.294: INFO: metadata-proxy-v0.1-rhhrk started at 2020-10-24 20:12:54 +0000 UTC (0+2 container statuses recorded) Oct 24 20:22:31.294: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:22:31.294: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:22:31.294: INFO: volume-snapshot-controller-0 started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container volume-snapshot-controller ready: true, restart count 0 Oct 24 20:22:31.294: INFO: kube-dns-autoscaler-76478fcf46-d99dr started at 2020-10-24 20:17:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container autoscaler ready: true, restart count 0 Oct 24 20:22:31.294: INFO: busybox-host-aliases919276e8-2683-4b06-ac29-33db6d430270 started at 2020-10-24 20:22:18 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container busybox-host-aliases919276e8-2683-4b06-ac29-33db6d430270 ready: true, restart count 0 Oct 24 20:22:31.294: INFO: hostexec-e2e-102521e575-a7d53-minion-group-svhc-mw65v started at <nil> (0+0 container statuses recorded) Oct 24 20:22:31.294: INFO: httpd started at 2020-10-24 20:22:21 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container httpd ready: false, restart count 0 Oct 24 20:22:31.294: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-svhc started at 2020-10-24 20:12:54 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:22:31.294: INFO: l7-default-backend-6f8dd4f4d5-fx47f started at 2020-10-24 20:13:08 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container default-http-backend ready: true, restart count 0 Oct 24 20:22:31.294: INFO: pod-projected-secrets-fa902678-5e86-4fdb-81bc-8f3da3da2132 started at 2020-10-24 20:21:42 +0000 UTC (0+3 container statuses recorded) Oct 24 20:22:31.294: INFO: Container creates-volume-test ready: true, restart count 0 Oct 24 20:22:31.294: INFO: Container dels-volume-test ready: true, restart count 0 Oct 24 20:22:31.294: INFO: Container upds-volume-test ready: true, restart count 0 Oct 24 20:22:31.294: INFO: pod-2287b8f5-2fac-43c1-94ad-0178a2300718 started at <nil> (0+0 container statuses recorded) Oct 24 20:22:31.294: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:21:00 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:22:31.294: INFO: busybox-privileged-false-7d127445-a97c-4d3f-87e4-bbeefe3c1404 started at 2020-10-24 20:22:24 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container busybox-privileged-false-7d127445-a97c-4d3f-87e4-bbeefe3c1404 ready: false, restart count 0 Oct 24 20:22:31.294: INFO: all-pods-removed-wdljb started at 2020-10-24 20:22:26 +0000 UTC (0+1 container statuses recorded) Oct 24 20:22:31.294: INFO: Container c ready: false, restart count 0 W1024 20:22:31.375323 16793 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:22:32.545: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-svhc Oct 24 20:22:32.545: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "dns-5159" for this suite.
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-network\]\sDNS\sshould\sprovide\sDNS\sfor\sservices\s\s\[Conformance\]$'
test/e2e/framework/framework.go:629 Oct 24 20:29:28.260: failed to create headless service: dns-test-service Unexpected error: <*errors.StatusError | 0xc000d917c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"dns-test-service\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "dns-test-service", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "dns-test-service" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred test/e2e/network/dns.go:143
[BeforeEach] [sig-network] DNS test/e2e/framework/framework.go:174 �[1mSTEP�[0m: Creating a kubernetes client Oct 24 20:29:27.435: INFO: >>> kubeConfig: /workspace/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename dns �[1mSTEP�[0m: Binding the e2e-test-privileged-psp PodSecurityPolicy to the default service account in dns-2375 �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace [It] should provide DNS for services [Conformance] test/e2e/framework/framework.go:629 �[1mSTEP�[0m: Creating a test headless service Oct 24 20:29:28.260: FAIL: failed to create headless service: dns-test-service Unexpected error: <*errors.StatusError | 0xc000d917c0>: { ErrStatus: { TypeMeta: {Kind: "", APIVersion: ""}, ListMeta: { SelfLink: "", ResourceVersion: "", Continue: "", RemainingItemCount: nil, }, Status: "Failure", Message: "Service \"dns-test-service\" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Reason: "Invalid", Details: { Name: "dns-test-service", Group: "", Kind: "Service", UID: "", Causes: [ { Type: "FieldValueInvalid", Message: "Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16", Field: "spec.clusterIPs", }, ], RetryAfterSeconds: 0, }, Code: 422, }, } Service "dns-test-service" is invalid: spec.clusterIPs: Invalid value: []string(nil): failed to allocated ip:None with error:provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/16 occurred Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func2.5() test/e2e/network/dns.go:143 +0x330 k8s.io/kubernetes/test/e2e.RunE2ETests(0xc002954600) test/e2e/e2e.go:130 +0x345 k8s.io/kubernetes/test/e2e.TestE2E(0xc002954600) test/e2e/e2e_test.go:144 +0x2b testing.tRunner(0xc002954600, 0x4e2e798) GOROOT/src/testing/testing.go:1127 +0xef created by testing.(*T).Run GOROOT/src/testing/testing.go:1178 +0x386 [AfterEach] [sig-network] DNS test/e2e/framework/framework.go:175 �[1mSTEP�[0m: Collecting events from namespace "dns-2375". �[1mSTEP�[0m: Found 0 events. Oct 24 20:29:28.377: INFO: POD NODE PHASE GRACE CONDITIONS Oct 24 20:29:28.377: INFO: Oct 24 20:29:28.448: INFO: Logging node info for node e2e-102521e575-a7d53-master Oct 24 20:29:28.498: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-master 3ae886e1-f914-47c4-bc8c-a81578ee8021 35251 0 2020-10-24 20:12:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2020-10-24 20:12:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:12:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}}}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{20629221376 0} {<nil>} 20145724Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862544384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{18566299208 0} {<nil>} 18566299208 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3600400384 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:28:46 +0000 UTC,LastTransitionTime:2020-10-24 20:12:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.2,},NodeAddress{Type:ExternalIP,Address:35.197.94.102,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-master.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:f427d03836e6235ce54ea747d45bec4e,SystemUUID:f427d038-36e6-235c-e54e-a747d45bec4e,BootID:40e2a646-ecca-4fac-93a4-617148da9410,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:169180938,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:156145437,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 k8s.gcr.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:64999187,},ContainerImage{Names:[k8s.gcr.io/kube-addon-manager@sha256:c0ed56727cd78700034f2f863d774412c78681fb6535456f5e5c420f4248c5a1 k8s.gcr.io/kube-addon-manager:v9.1.1],SizeBytes:30515541,},ContainerImage{Names:[k8s.gcr.io/ingress-gce-glbc-amd64@sha256:1a859d138b4874642e9a8709e7ab04324669c77742349b5b21b1ef8a25fef55f k8s.gcr.io/ingress-gce-glbc-amd64:v1.6.1],SizeBytes:26526716,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:29:28.499: INFO: Logging kubelet events for node e2e-102521e575-a7d53-master Oct 24 20:29:28.556: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-master Oct 24 20:29:28.633: INFO: metadata-proxy-v0.1-xfcnx started at 2020-10-24 20:13:03 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:28.633: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:29:28.633: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:29:28.633: INFO: kube-controller-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:28.633: INFO: Container kube-controller-manager ready: true, restart count 0 Oct 24 20:29:28.633: INFO: kube-scheduler-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:28.633: INFO: Container kube-scheduler ready: true, restart count 0 Oct 24 20:29:28.633: INFO: etcd-server-events-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:28.633: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:29:28.633: INFO: etcd-server-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:28.633: INFO: Container etcd-container ready: true, restart count 0 Oct 24 20:29:28.633: INFO: kube-apiserver-e2e-102521e575-a7d53-master started at 2020-10-24 20:11:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:28.633: INFO: Container kube-apiserver ready: true, restart count 0 Oct 24 20:29:28.633: INFO: kube-addon-manager-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:15 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:28.633: INFO: Container kube-addon-manager ready: true, restart count 0 Oct 24 20:29:28.633: INFO: l7-lb-controller-e2e-102521e575-a7d53-master started at 2020-10-24 20:12:16 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:28.633: INFO: Container l7-lb-controller ready: true, restart count 2 W1024 20:29:28.720589 16828 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:29:29.097: INFO: Latency metrics for node e2e-102521e575-a7d53-master Oct 24 20:29:29.097: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:29.162: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fd8r 4d6689b6-9df2-4113-b64d-abc76cdc22af 37002 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fd8r kubernetes.io/os:linux mounted_volume_expand:mounted-volume-expand-8838 node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:e2e-102521e575-a7d53-minion-group-fd8r topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-4306":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-ephemeral-9113":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-3917":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-4201":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-provisioning-7245":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-6962":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-1341":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4518":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-4733":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volume-expand-5994":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-5360":"e2e-102521e575-a7d53-minion-group-fd8r","csi-hostpath-volumemode-9841":"e2e-102521e575-a7d53-minion-group-fd8r","csi-mock-csi-mock-volumes-261":"csi-mock-csi-mock-volumes-261","csi-mock-csi-mock-volumes-4133":"csi-mock-csi-mock-volumes-4133","csi-mock-csi-mock-volumes-7525":"csi-mock-csi-mock-volumes-7525","csi-mock-csi-mock-volumes-9469":"csi-mock-csi-mock-volumes-9469"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{node-problem-detector Update v1 2020-10-24 20:13:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}}} {e2e.test Update v1 2020-10-24 20:23:10 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:mounted_volume_expand":{}}}}} {kube-controller-manager Update v1 2020-10-24 20:28:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}},"f:labels":{"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}}} {kubelet Update v1 2020-10-24 20:28:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/instance-type":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.hostpath.csi/node":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:addresses":{".":{},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"InternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:allocatable":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:capacity":{".":{},"f:attachable-volumes-gce-pd":{},"f:cpu":{},"f:ephemeral-storage":{},"f:hugepages-1Gi":{},"f:hugepages-2Mi":{},"f:memory":{},"f:pods":{}},"f:conditions":{".":{},"k:{\"type\":\"DiskPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"MemoryPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}},"k:{\"type\":\"PIDPressure\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:config":{},"f:daemonEndpoints":{"f:kubeletEndpoint":{"f:Port":{}}},"f:images":{},"f:nodeInfo":{"f:architecture":{},"f:bootID":{},"f:containerRuntimeVersion":{},"f:kernelVersion":{},"f:kubeProxyVersion":{},"f:kubeletVersion":{},"f:machineID":{},"f:operatingSystem":{},"f:osImage":{},"f:systemUUID":{}},"f:volumesInUse":{}}}}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-infra-e2e-boskos-011/us-west1-b/e2e-102521e575-a7d53-minion-group-fd8r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{103880232960 0} {<nil>} 101445540Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7819644928 0} {<nil>} 7636372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{93492209510 0} {<nil>} 93492209510 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7557500928 0} {<nil>} 7380372Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:True,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:23:01 +0000 UTC,Reason:AUFSUmountHung,Message:kernel: INFO: task umount.aufs:21568 blocked for more than 120 seconds.,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2020-10-24 20:28:02 +0000 UTC,LastTransitionTime:2020-10-24 20:13:04 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2020-10-24 20:12:58 +0000 UTC,LastTransitionTime:2020-10-24 20:12:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2020-10-24 20:29:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:45 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2020-10-24 20:29:21 +0000 UTC,LastTransitionTime:2020-10-24 20:12:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.40.0.3,},NodeAddress{Type:ExternalIP,Address:34.82.100.10,},NodeAddress{Type:InternalDNS,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},NodeAddress{Type:Hostname,Address:e2e-102521e575-a7d53-minion-group-fd8r.c.k8s-infra-e2e-boskos-011.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:9c6dc6b3b7dd6493e80e3a1b75c4a78f,SystemUUID:9c6dc6b3-b7dd-6493-e80e-3a1b75c4a78f,BootID:da345351-a5cd-4bf0-9b36-4e9e39d39883,KernelVersion:5.4.0-1009-gcp,OSImage:Ubuntu 20.04 LTS,ContainerRuntimeVersion:containerd://1.4.0,KubeletVersion:v1.20.0-alpha.3.133+7bcfce373503ce,KubeProxyVersion:v1.20.0-alpha.3.133+7bcfce373503ce,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.20.0-alpha.3.133_7bcfce373503ce],SizeBytes:135965290,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/gluster@sha256:e2d3308b2d27499d59f120ff46dfc6c4cb307a3f207f02894ecab902583761c9 gcr.io/kubernetes-e2e-test-images/volume/gluster:1.0],SizeBytes:111775822,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/volume/nfs@sha256:c2ad734346f608a5f7d69cfded93c4e8094069320657bd372d12ba21dea3ea71 gcr.io/kubernetes-e2e-test-images/volume/nfs:1.0],SizeBytes:82348896,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:ab055cd3d45f50b90732c14593a5bf50f210871bb4f91994c756fc22db6d922a k8s.gcr.io/e2e-test-images/agnhost:2.21],SizeBytes:46251468,},ContainerImage{Names:[k8s.gcr.io/node-problem-detector@sha256:276335fa25a703615cc2f2cdc51ba693fac4bdd70baa63f9cbf228291defd776 k8s.gcr.io/node-problem-detector:v0.8.0],SizeBytes:44645326,},ContainerImage{Names:[docker.io/library/httpd@sha256:eb8ccf084cf3e80eece1add239effefd171eb39adbc154d33c14260d905d4060 docker.io/library/httpd:2.4.38-alpine],SizeBytes:40765017,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:4c9410a4ee555dcb0e8b7bd6fc77c65ac400f7c5bd4555df8187630efaea6ea4 k8s.gcr.io/build-image/debian-iptables:buster-v1.3.0],SizeBytes:37934917,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:78e3393f5fd5ff6c1e5dada2478cfa456fb7164929e573cf9a87bf6532730679 k8s.gcr.io/sig-storage/csi-provisioner:v1.6.0],SizeBytes:19408504,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:35ead85dd09aa8cc612fdb598d4e0e2f048bef816f1b74df5eeab67cd21b10aa k8s.gcr.io/sig-storage/csi-snapshotter:v2.1.0],SizeBytes:18487038,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:2ffa647e8107cfd39e5f464e738dce014c9f5e51b108da36c3ab621048d0bbab k8s.gcr.io/sig-storage/csi-attacher:v2.2.0],SizeBytes:18451536,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:6c6a0332693a7c456378f6abd2bb40611826c1e1a733cadbdae2daab3125b71c k8s.gcr.io/sig-storage/csi-resizer:v0.5.0],SizeBytes:18412631,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonroot@sha256:4bd7ae247de5c988700233c5a4b55e804ffe90f8c66ae64853f1dae37b847213 gcr.io/kubernetes-e2e-test-images/nonroot:1.0],SizeBytes:17747507,},ContainerImage{Names:[k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1],SizeBytes:15208262,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:d2b357bb02430fee9eaa43b16083981463d260419fe3acb2f560ede5c129f6f5 k8s.gcr.io/sig-storage/hostpathplugin:v1.4.0],SizeBytes:13995876,},ContainerImage{Names:[k8s.gcr.io/coredns@sha256:73ca82b4ce829766d4f1f10947c3a338888f876fbed0540dc849c89ff256e90c k8s.gcr.io/coredns:1.7.0],SizeBytes:13982350,},ContainerImage{Names:[k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b k8s.gcr.io/metrics-server-amd64:v0.3.6],SizeBytes:10542830,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/addon-resizer@sha256:35745de3c9a2884d53ad0e81b39f1eed9a7c77f5f909b9e84f9712b37ffb3021 k8s.gcr.io/addon-resizer:1.8.11],SizeBytes:9347950,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:0b4273abac4c241fa3d70aaf52b0d79a133d2737081f4a5c5dea4949f6c45dc3 k8s.gcr.io/sig-storage/mock-driver:v3.1.0],SizeBytes:8761232,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:9622c6a6dac7499a055a382930f4de82905a3c5735c0753f7094115c9c871309 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v1.3.0],SizeBytes:7717137,},ContainerImage{Names:[docker.io/library/nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 docker.io/library/nginx:1.14-alpine],SizeBytes:6978806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:f8cec70adc74897ddde5da4f1da0209a497370eaf657566e2b36bc5f0f3ccbd7 k8s.gcr.io/sig-storage/livenessprobe:v1.1.0],SizeBytes:6691212,},ContainerImage{Names:[k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a k8s.gcr.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0],SizeBytes:3054649,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/metadata-concealment@sha256:e38f92502f6f6a175fb15b5ce2d02229d465b419d4a643f5999a0f88ee170dcc gcr.io/kubernetes-e2e-test-images/metadata-concealment:1.2],SizeBytes:2002029,},ContainerImage{Names:[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0],SizeBytes:1804628,},ContainerImage{Names:[docker.io/library/busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 docker.io/library/busybox:1.29],SizeBytes:732685,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-4518^8c49ccd4-1637-11eb-93bf-8e3690743349],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-4518^8c49ccd4-1637-11eb-93bf-8e3690743349,DevicePath:,},},Config:&NodeConfigStatus{Assigned:nil,Active:nil,LastKnownGood:nil,Error:,},},} Oct 24 20:29:29.162: INFO: Logging kubelet events for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:29.336: INFO: Logging pods the kubelet thinks is on node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:29.519: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:29:29.519: INFO: pod-bbd31f60-f881-483f-a69e-a42941fb2eec started at 2020-10-24 20:29:01 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container write-pod ready: true, restart count 0 Oct 24 20:29:29.519: INFO: metadata-proxy-v0.1-mjtl8 started at 2020-10-24 20:12:45 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:29.519: INFO: Container metadata-proxy ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:27:51 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:29.519: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpath-attacher-0 started at 2020-10-24 20:28:56 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:29:29.519: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-t9psk started at 2020-10-24 20:29:27 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:29:29.519: INFO: kube-proxy-e2e-102521e575-a7d53-minion-group-fd8r started at 2020-10-24 20:12:45 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container kube-proxy ready: true, restart count 0 Oct 24 20:29:29.519: INFO: test-rolling-update-with-lb-5b74d4d4b5-d4dqx started at 2020-10-24 20:29:13 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container agnhost ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-mockplugin-0 started at 2020-10-24 20:29:20 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container driver-registrar ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container mock ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:28:55 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:28:55 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:29:29.519: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-j7qrs started at 2020-10-24 20:29:02 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container agnhost-container ready: true, restart count 0 Oct 24 20:29:29.519: INFO: service-proxy-toggled-4x5v7 started at 2020-10-24 20:28:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container service-proxy-toggled ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpathplugin-0 started at 2020-10-24 20:28:54 +0000 UTC (0+3 container statuses recorded) Oct 24 20:29:29.519: INFO: Container hostpath ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container liveness-probe ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container node-driver-registrar ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpath-snapshotter-0 started at 2020-10-24 20:27:52 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-snapshotter ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:29:29.519: INFO: hostexec-e2e-102521e575-a7d53-minion-group-fd8r-8xxr2 started at <nil> (0+0 container statuses recorded) Oct 24 20:29:29.519: INFO: csi-hostpath-provisioner-0 started at 2020-10-24 20:28:55 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-provisioner ready: true, restart count 0 Oct 24 20:29:29.519: INFO: privileged-pod started at 2020-10-24 20:28:42 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:29.519: INFO: Container not-privileged-container ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container privileged-container ready: true, restart count 0 Oct 24 20:29:29.519: INFO: service-proxy-disabled-sxwqj started at 2020-10-24 20:28:37 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container service-proxy-disabled ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-mockplugin-attacher-0 started at 2020-10-24 20:29:20 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-attacher ready: true, restart count 0 Oct 24 20:29:29.519: INFO: pvc-volume-tester-8lkhz started at 2020-10-24 20:29:29 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container volume-tester ready: false, restart count 0 Oct 24 20:29:29.519: INFO: npd-v0.8.0-qljkb started at 2020-10-24 20:12:58 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container node-problem-detector ready: true, restart count 0 Oct 24 20:29:29.519: INFO: coredns-6954c77b9b-v4qdt started at 2020-10-24 20:13:07 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container coredns ready: true, restart count 0 Oct 24 20:29:29.519: INFO: metrics-server-v0.3.6-8b98f98c9-h9tpk started at 2020-10-24 20:13:35 +0000 UTC (0+2 container statuses recorded) Oct 24 20:29:29.519: INFO: Container metrics-server ready: true, restart count 0 Oct 24 20:29:29.519: INFO: Container metrics-server-nanny ready: true, restart count 0 Oct 24 20:29:29.519: INFO: csi-hostpath-resizer-0 started at 2020-10-24 20:27:53 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container csi-resizer ready: true, restart count 0 Oct 24 20:29:29.519: INFO: pod-f82665db-647d-4924-ac0f-ef38bc4cc6da started at 2020-10-24 20:29:19 +0000 UTC (0+1 container statuses recorded) Oct 24 20:29:29.519: INFO: Container write-pod ready: false, restart count 0 W1024 20:29:29.574297 16828 metrics_grabber.go:105] Did not receive an external client interface. Grabbing metrics from ClusterAutoscaler is disabled. Oct 24 20:29:31.121: INFO: Latency metrics for node e2e-102521e575-a7d53-minion-group-fd8r Oct 24 20:29:31.121: INFO: Logging node info for node e2e-102521e575-a7d53-minion-group-fgpg Oct 24 20:29:31.162: INFO: Node Info: &Node{ObjectMeta:{e2e-102521e575-a7d53-minion-group-fgpg e3c5cdaa-eacd-4835-8684-aef4c1790ce1 36991 0 2020-10-24 20:12:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:e2e-102521e575-a7d53-minion-group-fgpg kubernetes.io/os:linux node.kubernetes.io/i