ci-cri-containerd-e2e-cos-gce-proto #1596399097839882240
Recent runs || View in Spyglass
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAPI\spriority\sand\sfairness\sshould\sensure\sthat\srequests\scan\'t\sbe\sdrowned\sout\s\(fairness\)$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001263ef0) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] API priority and fairness set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:12:08.578 Nov 26 07:12:08.578: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename apf 11/26/22 07:12:08.58 Nov 26 07:12:08.619: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:10.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:12.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:14.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:16.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:18.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:20.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:22.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:24.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:26.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:28.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:30.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:32.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:34.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:36.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:38.659: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:38.698: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:38.698: INFO: Unexpected error: <*errors.errorString | 0xc00017fa30>: { s: "timed out waiting for the condition", } Nov 26 07:12:38.698: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc001263ef0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] API priority and fairness test/e2e/framework/node/init/init.go:32 Nov 26 07:12:38.699: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] API priority and fairness dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:12:38.738 [DeferCleanup (Each)] [sig-api-machinery] API priority and fairness tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\slisting\smutating\swebhooks\sshould\swork\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000b67e00) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:25:33.229 Nov 26 07:25:33.229: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename webhook 11/26/22 07:25:33.23 Nov 26 07:25:33.269: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:35.310: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:37.309: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:39.310: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:41.309: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:43.309: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:45.310: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:47.309: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:49.310: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:27:55.354: INFO: Unexpected error: <*fmt.wrapError | 0xc000e4a020>: { msg: "wait for service account \"default\" in namespace \"webhook-8291\": timed out waiting for the condition", err: <*errors.errorString | 0xc0001ffa10>{ s: "timed out waiting for the condition", }, } Nov 26 07:27:55.354: FAIL: wait for service account "default" in namespace "webhook-8291": timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000b67e00) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 07:27:55.354: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/webhook.go:105 [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:27:55.632 STEP: Collecting events from namespace "webhook-8291". 11/26/22 07:27:55.632 STEP: Found 0 events. 11/26/22 07:27:55.787 Nov 26 07:27:55.889: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 07:27:55.889: INFO: Nov 26 07:27:55.938: INFO: Logging node info for node bootstrap-e2e-master Nov 26 07:27:56.028: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 10560 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:25:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:27:56.028: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 07:27:56.080: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 07:27:56.778: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container kube-apiserver ready: true, restart count 2 Nov 26 07:27:56.778: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container kube-scheduler ready: true, restart count 3 Nov 26 07:27:56.778: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container kube-addon-manager ready: true, restart count 0 Nov 26 07:27:56.778: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container etcd-container ready: true, restart count 1 Nov 26 07:27:56.778: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container konnectivity-server-container ready: true, restart count 3 Nov 26 07:27:56.778: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container l7-lb-controller ready: false, restart count 5 Nov 26 07:27:56.778: INFO: metadata-proxy-v0.1-c2shf started at 2022-11-26 07:10:15 +0000 UTC (0+2 container statuses recorded) Nov 26 07:27:56.778: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:27:56.778: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:27:56.778: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container etcd-container ready: true, restart count 2 Nov 26 07:27:56.778: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:56.778: INFO: Container kube-controller-manager ready: false, restart count 6 Nov 26 07:27:57.563: INFO: Latency metrics for node bootstrap-e2e-master Nov 26 07:27:57.563: INFO: Logging node info for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:27:57.607: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 10567 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:25:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:27:57.608: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:27:57.671: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8 Nov 26 07:27:58.118: INFO: pod-update-activedeadlineseconds-5955fd5a-b020-4868-bf7d-f791bacdcebd started at 2022-11-26 07:19:19 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container pause ready: false, restart count 1 Nov 26 07:27:58.118: INFO: kube-proxy-bootstrap-e2e-minion-group-dwd8 started at 2022-11-26 07:09:52 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 07:27:58.118: INFO: metadata-proxy-v0.1-hcl5n started at 2022-11-26 07:09:53 +0000 UTC (0+2 container statuses recorded) Nov 26 07:27:58.118: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:27:58.118: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:27:58.118: INFO: test-pod-3 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container token-test ready: false, restart count 0 Nov 26 07:27:58.118: INFO: metrics-server-v0.5.2-867b8754b9-zrfqf started at 2022-11-26 07:10:22 +0000 UTC (0+2 container statuses recorded) Nov 26 07:27:58.118: INFO: Container metrics-server ready: false, restart count 6 Nov 26 07:27:58.118: INFO: Container metrics-server-nanny ready: false, restart count 7 Nov 26 07:27:58.118: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-gcbfg started at 2022-11-26 07:11:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container sample-crd-conversion-webhook ready: false, restart count 6 Nov 26 07:27:58.118: INFO: implicit-nonroot-uid started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container implicit-nonroot-uid ready: false, restart count 0 Nov 26 07:27:58.118: INFO: pfpod started at 2022-11-26 07:19:18 +0000 UTC (0+2 container statuses recorded) Nov 26 07:27:58.118: INFO: Container portforwardtester ready: false, restart count 0 Nov 26 07:27:58.118: INFO: Container readiness ready: false, restart count 0 Nov 26 07:27:58.118: INFO: up-down-1-ffjgt started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container up-down-1 ready: true, restart count 4 Nov 26 07:27:58.118: INFO: concurrent-27824123-hdhlc started at 2022-11-26 07:23:22 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container c ready: true, restart count 3 Nov 26 07:27:58.118: INFO: e2e-zp4g8-hrbcn started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container c ready: false, restart count 0 Nov 26 07:27:58.118: INFO: inline-volume-tester-7vfrm started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 07:27:58.118: INFO: up-down-2-2pzwj started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container up-down-2 ready: false, restart count 3 Nov 26 07:27:58.118: INFO: verify-service-up-exec-pod-mf9vw started at 2022-11-26 07:23:51 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 07:27:58.118: INFO: test-webserver-039afd23-9dac-425b-8ec3-492edeedba63 started at 2022-11-26 07:23:53 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container test-webserver ready: true, restart count 3 Nov 26 07:27:58.118: INFO: external-provisioner-6zv6g started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container nfs-provisioner ready: false, restart count 6 Nov 26 07:27:58.118: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:54 +0000 UTC (0+7 container statuses recorded) Nov 26 07:27:58.118: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 07:27:58.118: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:27:58.118: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 07:27:58.118: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 07:27:58.118: INFO: Container hostpath ready: false, restart count 5 Nov 26 07:27:58.118: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 07:27:58.118: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 07:27:58.118: INFO: konnectivity-agent-qfhtq started at 2022-11-26 07:10:07 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container konnectivity-agent ready: false, restart count 6 Nov 26 07:27:58.118: INFO: busybox-baf67443-54ea-47c6-98aa-71ed72364ec4 started at 2022-11-26 07:23:57 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container busybox ready: true, restart count 1 Nov 26 07:27:58.118: INFO: e2e-zp4g8-48r9k started at 2022-11-26 07:11:57 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container c ready: false, restart count 0 Nov 26 07:27:58.118: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:35 +0000 UTC (0+7 container statuses recorded) Nov 26 07:27:58.118: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 07:27:58.118: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 07:27:58.118: INFO: Container csi-resizer ready: true, restart count 4 Nov 26 07:27:58.118: INFO: Container csi-snapshotter ready: true, restart count 4 Nov 26 07:27:58.118: INFO: Container hostpath ready: true, restart count 4 Nov 26 07:27:58.118: INFO: Container liveness-probe ready: true, restart count 4 Nov 26 07:27:58.118: INFO: Container node-driver-registrar ready: true, restart count 4 Nov 26 07:27:58.118: INFO: affinity-nodeport-pxjt4 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container affinity-nodeport ready: true, restart count 4 Nov 26 07:27:58.118: INFO: oidc-discovery-validator started at 2022-11-26 07:23:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container oidc-discovery-validator ready: false, restart count 0 Nov 26 07:27:58.118: INFO: concurrent-27824124-tz2n7 started at 2022-11-26 07:24:00 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container c ready: true, restart count 2 Nov 26 07:27:58.118: INFO: execpod-affinityj9z2l started at 2022-11-26 07:12:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:58.118: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 07:27:58.720: INFO: Latency metrics for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:27:58.720: INFO: Logging node info for node bootstrap-e2e-minion-group-fx4h Nov 26 07:27:58.763: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 10807 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8980":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4386":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4790":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9869":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:27:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:27:58.764: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-fx4h Nov 26 07:27:58.809: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h Nov 26 07:27:59.272: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-attacher ready: false, restart count 4 Nov 26 07:27:59.272: INFO: volume-snapshot-controller-0 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container volume-snapshot-controller ready: true, restart count 6 Nov 26 07:27:59.272: INFO: up-down-1-ghvx6 started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container up-down-1 ready: true, restart count 0 Nov 26 07:27:59.272: INFO: pod-configmaps-d8c89993-128a-416a-b57f-998af5485f65 started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 07:27:59.272: INFO: metadata-proxy-v0.1-tm7ft started at 2022-11-26 07:09:43 +0000 UTC (0+2 container statuses recorded) Nov 26 07:27:59.272: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:27:59.272: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:27:59.272: INFO: konnectivity-agent-sznlb started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container konnectivity-agent ready: true, restart count 6 Nov 26 07:27:59.272: INFO: pod-0525a741-dd01-4230-ab87-046a3722256a started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container write-pod ready: true, restart count 0 Nov 26 07:27:59.272: INFO: affinity-nodeport-xkl85 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container affinity-nodeport ready: false, restart count 5 Nov 26 07:27:59.272: INFO: csi-mockplugin-0 started at 2022-11-26 07:19:20 +0000 UTC (0+3 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 07:27:59.272: INFO: Container driver-registrar ready: true, restart count 2 Nov 26 07:27:59.272: INFO: Container mock ready: true, restart count 2 Nov 26 07:27:59.272: INFO: kube-proxy-bootstrap-e2e-minion-group-fx4h started at 2022-11-26 07:09:42 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 07:27:59.272: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-t94rt started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost-container ready: false, restart count 5 Nov 26 07:27:59.272: INFO: e2e-host-exec started at 2022-11-26 07:23:35 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container e2e-host-exec ready: true, restart count 1 Nov 26 07:27:59.272: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-vk4nw started at 2022-11-26 07:24:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost-container ready: true, restart count 1 Nov 26 07:27:59.272: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-k4crh started at 2022-11-26 07:11:49 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 07:27:59.272: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:19:20 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 07:27:59.272: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:12 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 07:27:59.272: INFO: pod3 started at 2022-11-26 07:23:32 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost ready: true, restart count 1 Nov 26 07:27:59.272: INFO: test-pod-1 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container token-test ready: false, restart count 0 Nov 26 07:27:59.272: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:17:10 +0000 UTC (0+7 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 07:27:59.272: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:27:59.272: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 07:27:59.272: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 07:27:59.272: INFO: Container hostpath ready: false, restart count 5 Nov 26 07:27:59.272: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 07:27:59.272: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 07:27:59.272: INFO: up-down-2-w26j5 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container up-down-2 ready: true, restart count 4 Nov 26 07:27:59.272: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:19:23 +0000 UTC (0+7 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 07:27:59.272: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 07:27:59.272: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 07:27:59.272: INFO: Container csi-snapshotter ready: true, restart count 5 Nov 26 07:27:59.272: INFO: Container hostpath ready: true, restart count 5 Nov 26 07:27:59.272: INFO: Container liveness-probe ready: true, restart count 5 Nov 26 07:27:59.272: INFO: Container node-driver-registrar ready: true, restart count 5 Nov 26 07:27:59.272: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-hrfdg started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost-container ready: false, restart count 4 Nov 26 07:27:59.272: INFO: pod1 started at 2022-11-26 07:23:26 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost ready: true, restart count 1 Nov 26 07:27:59.272: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:03 +0000 UTC (0+3 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-provisioner ready: true, restart count 6 Nov 26 07:27:59.272: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 07:27:59.272: INFO: Container mock ready: true, restart count 6 Nov 26 07:27:59.272: INFO: kube-dns-autoscaler-5f6455f985-mr42t started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container autoscaler ready: false, restart count 6 Nov 26 07:27:59.272: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:12 +0000 UTC (0+3 container statuses recorded) Nov 26 07:27:59.272: INFO: Container csi-provisioner ready: true, restart count 3 Nov 26 07:27:59.272: INFO: Container driver-registrar ready: true, restart count 3 Nov 26 07:27:59.272: INFO: Container mock ready: true, restart count 3 Nov 26 07:27:59.272: INFO: l7-default-backend-8549d69d99-wf7s6 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container default-http-backend ready: true, restart count 0 Nov 26 07:27:59.272: INFO: pod2 started at 2022-11-26 07:23:30 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container agnhost ready: false, restart count 3 Nov 26 07:27:59.272: INFO: pod-subpath-test-preprovisionedpv-snzn started at 2022-11-26 07:12:03 +0000 UTC (2+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Init container init-volume-preprovisionedpv-snzn ready: true, restart count 0 Nov 26 07:27:59.272: INFO: Init container test-init-volume-preprovisionedpv-snzn ready: true, restart count 0 Nov 26 07:27:59.272: INFO: Container test-container-subpath-preprovisionedpv-snzn ready: false, restart count 0 Nov 26 07:27:59.272: INFO: pod-subpath-test-preprovisionedpv-tzwd started at 2022-11-26 07:12:04 +0000 UTC (2+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Init container init-volume-preprovisionedpv-tzwd ready: true, restart count 0 Nov 26 07:27:59.272: INFO: Init container test-init-volume-preprovisionedpv-tzwd ready: true, restart count 0 Nov 26 07:27:59.272: INFO: Container test-container-subpath-preprovisionedpv-tzwd ready: false, restart count 0 Nov 26 07:27:59.272: INFO: coredns-6d97d5ddb-r7jr7 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:27:59.272: INFO: Container coredns ready: false, restart count 7 Nov 26 07:27:59.272: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+4 container statuses recorded) Nov 26 07:27:59.272: INFO: Container busybox ready: true, restart count 6 Nov 26 07:27:59.272: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 07:27:59.272: INFO: Container driver-registrar ready: false, restart count 7 Nov 26 07:27:59.272: INFO: Container mock ready: false, restart count 7 Nov 26 07:27:59.986: INFO: Latency metrics for node bootstrap-e2e-minion-group-fx4h Nov 26 07:27:59.986: INFO: Logging node info for node bootstrap-e2e-minion-group-s2jb Nov 26 07:28:00.051: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 10720 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7726":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:27:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:28:00.051: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-s2jb Nov 26 07:28:00.145: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb Nov 26 07:28:00.709: INFO: verify-service-up-host-exec-pod started at 2022-11-26 07:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 07:28:00.709: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+3 container statuses recorded) Nov 26 07:28:00.709: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:28:00.709: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 07:28:00.709: INFO: Container mock ready: false, restart count 5 Nov 26 07:28:00.709: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-bnhs4 started at 2022-11-26 07:19:40 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 07:28:00.709: INFO: apparmor-loader-95hjv started at 2022-11-26 07:23:39 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container apparmor-loader ready: true, restart count 0 Nov 26 07:28:00.709: INFO: client-containers-176852e0-aa4f-4787-8c18-2f872553a326 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 07:28:00.709: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-lsrjh started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 07:28:00.709: INFO: kube-proxy-bootstrap-e2e-minion-group-s2jb started at 2022-11-26 07:09:43 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container kube-proxy ready: true, restart count 7 Nov 26 07:28:00.709: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:11:52 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 07:28:00.709: INFO: pod-1 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container donothing ready: true, restart count 4 Nov 26 07:28:00.709: INFO: e2e-zp4g8-89zc8 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container c ready: false, restart count 0 Nov 26 07:28:00.709: INFO: konnectivity-agent-5cmvk started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container konnectivity-agent ready: false, restart count 6 Nov 26 07:28:00.709: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-7xqc7 started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container agnhost-container ready: false, restart count 6 Nov 26 07:28:00.709: INFO: test-pod-2 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container token-test ready: false, restart count 0 Nov 26 07:28:00.709: INFO: pod-0 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container donothing ready: true, restart count 5 Nov 26 07:28:00.709: INFO: pod-subpath-test-preprovisionedpv-xn2t started at 2022-11-26 07:12:04 +0000 UTC (1+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Init container init-volume-preprovisionedpv-xn2t ready: true, restart count 0 Nov 26 07:28:00.709: INFO: Container test-container-subpath-preprovisionedpv-xn2t ready: false, restart count 0 Nov 26 07:28:00.709: INFO: coredns-6d97d5ddb-qnmdd started at 2022-11-26 07:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container coredns ready: false, restart count 7 Nov 26 07:28:00.709: INFO: pod-2 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container donothing ready: true, restart count 4 Nov 26 07:28:00.709: INFO: up-down-2-9qgl7 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container up-down-2 ready: true, restart count 3 Nov 26 07:28:00.709: INFO: httpd started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container httpd ready: false, restart count 6 Nov 26 07:28:00.709: INFO: test-apparmor-88fsj started at 2022-11-26 07:23:50 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container test ready: false, restart count 0 Nov 26 07:28:00.709: INFO: e2e-zp4g8-rlbsv started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container c ready: false, restart count 0 Nov 26 07:28:00.709: INFO: up-down-1-7kskn started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container up-down-1 ready: true, restart count 0 Nov 26 07:28:00.709: INFO: csi-mockplugin-0 started at 2022-11-26 07:23:47 +0000 UTC (0+3 container statuses recorded) Nov 26 07:28:00.709: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 07:28:00.709: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 07:28:00.709: INFO: Container mock ready: true, restart count 5 Nov 26 07:28:00.709: INFO: pod-secrets-2fe85272-67c8-4ec5-8f6a-1601198e215a started at 2022-11-26 07:11:56 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container secret-volume-test ready: false, restart count 0 Nov 26 07:28:00.709: INFO: metadata-proxy-v0.1-ztb2m started at 2022-11-26 07:09:44 +0000 UTC (0+2 container statuses recorded) Nov 26 07:28:00.709: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:28:00.709: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:28:00.709: INFO: external-provisioner-hh2kt started at 2022-11-26 07:11:50 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container nfs-provisioner ready: true, restart count 5 Nov 26 07:28:00.709: INFO: pod-8975089f-4c51-4935-824c-48dec8be150b started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container write-pod ready: false, restart count 0 Nov 26 07:28:00.709: INFO: affinity-nodeport-w6shs started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:00.709: INFO: Container affinity-nodeport ready: true, restart count 3 Nov 26 07:28:01.186: INFO: Latency metrics for node bootstrap-e2e-minion-group-s2jb [DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "webhook-8291" for this suite. 11/26/22 07:28:01.186
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\spatching\/updating\sa\svalidating\swebhook\sshould\swork\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc00121be00, {0xc0037cc090, 0x2c}, 0xc002422370, 0x20fb, 0x20fc)
test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
test/e2e/apimachinery/webhook.go:102 +0x226
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:50:06.013: failed to list events in namespace "webhook-346": Get "https://34.83.149.76/api/v1/namespaces/webhook-346/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:50:06.094: Couldn't delete ns: "webhook-346-markers": Delete "https://34.83.149.76/api/v1/namespaces/webhook-346-markers": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/webhook-346-markers", Err:(*net.OpError)(0xc0030f59f0)}),Couldn't delete ns: "webhook-346": Delete "https://34.83.149.76/api/v1/namespaces/webhook-346": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/webhook-346", Err:(*net.OpError)(0xc003184ff0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:49:53.662
Nov 26 07:49:53.662: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/26/22 07:49:53.664
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:49:53.849
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:49:53.939
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/26/22 07:49:54.24
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 07:49:54.544
STEP: Deploying the webhook pod 11/26/22 07:49:54.847
STEP: Wait for the deployment to be ready 11/26/22 07:49:55.079
Nov 26 07:49:55.304: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set
Nov 26 07:49:57.737: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:49:59.853: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:50:01.825: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:50:03.860: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 49, 55, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:50:05.777: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-346):
<*errors.errorString | 0xc000d877b0>: {
s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: Get \"https://34.83.149.76/apis/apps/v1/namespaces/webhook-346/deployments/sample-webhook-deployment\": dial tcp 34.83.149.76:443: connect: connection refused",
}
Nov 26 07:50:05.777: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-346): error waiting for deployment "sample-webhook-deployment" status to match expectation: Get "https://34.83.149.76/apis/apps/v1/namespaces/webhook-346/deployments/sample-webhook-deployment": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc00121be00, {0xc0037cc090, 0x2c}, 0xc002422370, 0x20fb, 0x20fc)
test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
test/e2e/apimachinery/webhook.go:102 +0x226
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 26 07:50:05.778: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:50:05.974
STEP: Collecting events from namespace "webhook-346". 11/26/22 07:50:05.974
Nov 26 07:50:06.013: INFO: Unexpected error: failed to list events in namespace "webhook-346":
<*url.Error | 0xc002f7daa0>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/webhook-346/events",
Err: <*net.OpError | 0xc0030f53b0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00193c900>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc000d99b80>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:50:06.013: FAIL: failed to list events in namespace "webhook-346": Get "https://34.83.149.76/api/v1/namespaces/webhook-346/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0025585c0, {0xc0035090c0, 0xb})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc002061ba0}, {0xc0035090c0, 0xb})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc002558650?, {0xc0035090c0?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc00121be00)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc0014db7e0?, 0xc003168fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc002c87748?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0014db7e0?, 0x29449fc?}, {0xae73300?, 0xc003168f80?, 0x2a6d786?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-346" for this suite. 11/26/22 07:50:06.014
STEP: Destroying namespace "webhook-346-markers" for this suite. 11/26/22 07:50:06.053
Nov 26 07:50:06.094: FAIL: Couldn't delete ns: "webhook-346-markers": Delete "https://34.83.149.76/api/v1/namespaces/webhook-346-markers": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/webhook-346-markers", Err:(*net.OpError)(0xc0030f59f0)}),Couldn't delete ns: "webhook-346": Delete "https://34.83.149.76/api/v1/namespaces/webhook-346": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/webhook-346", Err:(*net.OpError)(0xc003184ff0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc00121be00)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0014db720?, 0xc00228efb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0014db720?, 0x0?}, {0xae73300?, 0x5?, 0xc003509ca0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\scustom\sresource\screation\,\supdate\sand\sdeletion\s\[Conformance\]$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00106de00)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
test/e2e/apimachinery/webhook.go:1680 +0x46
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
test/e2e/apimachinery/webhook.go:106 +0x2f
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:27:23.619
Nov 26 07:27:23.619: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/26/22 07:27:23.62
Nov 26 07:29:23.669: INFO: Unexpected error:
<*fmt.wrapError | 0xc0014b4040>: {
msg: "wait for service account \"default\" in namespace \"webhook-2323\": timed out waiting for the condition",
err: <*errors.errorString | 0xc00017fa10>{
s: "timed out waiting for the condition",
},
}
Nov 26 07:29:23.669: FAIL: wait for service account "default" in namespace "webhook-2323": timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00106de00)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 26 07:29:23.669: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:29:28.666
STEP: Collecting events from namespace "webhook-2323". 11/26/22 07:29:28.666
STEP: Found 0 events. 11/26/22 07:29:28.719
Nov 26 07:29:29.885: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 26 07:29:29.885: INFO:
Nov 26 07:29:29.967: INFO:
Logging node info for node bootstrap-e2e-master
Nov 26 07:29:30.038: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 10560 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:25:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:29:30.039: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 26 07:29:30.107: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 26 07:29:30.169: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container l7-lb-controller ready: false, restart count 6
Nov 26 07:29:30.169: INFO: metadata-proxy-v0.1-c2shf started at 2022-11-26 07:10:15 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:29:30.169: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:29:30.169: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container etcd-container ready: true, restart count 2
Nov 26 07:29:30.169: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container kube-controller-manager ready: true, restart count 7
Nov 26 07:29:30.169: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container kube-apiserver ready: true, restart count 2
Nov 26 07:29:30.169: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container kube-scheduler ready: false, restart count 4
Nov 26 07:29:30.169: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container kube-addon-manager ready: true, restart count 0
Nov 26 07:29:30.169: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container etcd-container ready: true, restart count 2
Nov 26 07:29:30.169: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.169: INFO: Container konnectivity-server-container ready: true, restart count 3
Nov 26 07:29:30.428: INFO:
Latency metrics for node bootstrap-e2e-master
Nov 26 07:29:30.428: INFO:
Logging node info for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:29:30.473: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 11055 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5439":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:29:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:29:28 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:29:28 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:29:28 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:29:28 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:29:30.473: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:29:30.535: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8
Nov 26 07:29:30.655: INFO: e2e-zp4g8-hrbcn started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container c ready: false, restart count 0
Nov 26 07:29:30.655: INFO: inline-volume-tester-7vfrm started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container csi-volume-tester ready: false, restart count 0
Nov 26 07:29:30.655: INFO: up-down-2-2pzwj started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container up-down-2 ready: false, restart count 4
Nov 26 07:29:30.655: INFO: test-webserver-039afd23-9dac-425b-8ec3-492edeedba63 started at 2022-11-26 07:23:53 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container test-webserver ready: true, restart count 3
Nov 26 07:29:30.655: INFO: external-provisioner-6zv6g started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container nfs-provisioner ready: false, restart count 6
Nov 26 07:29:30.655: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:54 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container csi-attacher ready: true, restart count 6
Nov 26 07:29:30.655: INFO: Container csi-provisioner ready: true, restart count 6
Nov 26 07:29:30.655: INFO: Container csi-resizer ready: true, restart count 6
Nov 26 07:29:30.655: INFO: Container csi-snapshotter ready: true, restart count 6
Nov 26 07:29:30.655: INFO: Container hostpath ready: true, restart count 6
Nov 26 07:29:30.655: INFO: Container liveness-probe ready: true, restart count 6
Nov 26 07:29:30.655: INFO: Container node-driver-registrar ready: true, restart count 6
Nov 26 07:29:30.655: INFO: konnectivity-agent-qfhtq started at 2022-11-26 07:10:07 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container konnectivity-agent ready: true, restart count 7
Nov 26 07:29:30.655: INFO: busybox-baf67443-54ea-47c6-98aa-71ed72364ec4 started at 2022-11-26 07:23:57 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container busybox ready: true, restart count 2
Nov 26 07:29:30.655: INFO: e2e-zp4g8-48r9k started at 2022-11-26 07:11:57 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container c ready: false, restart count 0
Nov 26 07:29:30.655: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:35 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container csi-attacher ready: true, restart count 7
Nov 26 07:29:30.655: INFO: Container csi-provisioner ready: true, restart count 7
Nov 26 07:29:30.655: INFO: Container csi-resizer ready: true, restart count 7
Nov 26 07:29:30.655: INFO: Container csi-snapshotter ready: true, restart count 7
Nov 26 07:29:30.655: INFO: Container hostpath ready: true, restart count 7
Nov 26 07:29:30.655: INFO: Container liveness-probe ready: true, restart count 7
Nov 26 07:29:30.655: INFO: Container node-driver-registrar ready: true, restart count 7
Nov 26 07:29:30.655: INFO: affinity-nodeport-pxjt4 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container affinity-nodeport ready: true, restart count 4
Nov 26 07:29:30.655: INFO: oidc-discovery-validator started at 2022-11-26 07:23:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container oidc-discovery-validator ready: false, restart count 0
Nov 26 07:29:30.655: INFO: concurrent-27824124-tz2n7 started at 2022-11-26 07:24:00 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container c ready: true, restart count 3
Nov 26 07:29:30.655: INFO: execpod-affinityj9z2l started at 2022-11-26 07:12:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container agnhost-container ready: true, restart count 3
Nov 26 07:29:30.655: INFO: pod-update-activedeadlineseconds-5955fd5a-b020-4868-bf7d-f791bacdcebd started at 2022-11-26 07:19:19 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container pause ready: false, restart count 1
Nov 26 07:29:30.655: INFO: kube-proxy-bootstrap-e2e-minion-group-dwd8 started at 2022-11-26 07:09:52 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container kube-proxy ready: false, restart count 7
Nov 26 07:29:30.655: INFO: metadata-proxy-v0.1-hcl5n started at 2022-11-26 07:09:53 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:29:30.655: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:29:30.655: INFO: test-pod-3 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container token-test ready: false, restart count 0
Nov 26 07:29:30.655: INFO: metrics-server-v0.5.2-867b8754b9-zrfqf started at 2022-11-26 07:10:22 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container metrics-server ready: false, restart count 6
Nov 26 07:29:30.655: INFO: Container metrics-server-nanny ready: false, restart count 7
Nov 26 07:29:30.655: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-gcbfg started at 2022-11-26 07:11:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container sample-crd-conversion-webhook ready: false, restart count 7
Nov 26 07:29:30.655: INFO: implicit-nonroot-uid started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container implicit-nonroot-uid ready: false, restart count 0
Nov 26 07:29:30.655: INFO: pfpod started at 2022-11-26 07:19:18 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container portforwardtester ready: false, restart count 0
Nov 26 07:29:30.655: INFO: Container readiness ready: false, restart count 0
Nov 26 07:29:30.655: INFO: up-down-1-ffjgt started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container up-down-1 ready: false, restart count 4
Nov 26 07:29:30.655: INFO: concurrent-27824123-hdhlc started at 2022-11-26 07:23:22 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:30.655: INFO: Container c ready: true, restart count 3
Nov 26 07:29:30.912: INFO:
Latency metrics for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:29:30.912: INFO:
Logging node info for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:29:30.956: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 11054 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8980":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4790":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9869":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:29:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:29:30.956: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:29:31.014: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h
Nov 26 07:29:31.092: INFO: metadata-proxy-v0.1-tm7ft started at 2022-11-26 07:09:43 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:29:31.092: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:29:31.092: INFO: konnectivity-agent-sznlb started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container konnectivity-agent ready: false, restart count 6
Nov 26 07:29:31.092: INFO: pod-0525a741-dd01-4230-ab87-046a3722256a started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container write-pod ready: true, restart count 0
Nov 26 07:29:31.092: INFO: affinity-nodeport-xkl85 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container affinity-nodeport ready: true, restart count 6
Nov 26 07:29:31.092: INFO: csi-mockplugin-0 started at 2022-11-26 07:19:20 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-provisioner ready: true, restart count 2
Nov 26 07:29:31.092: INFO: Container driver-registrar ready: true, restart count 2
Nov 26 07:29:31.092: INFO: Container mock ready: true, restart count 2
Nov 26 07:29:31.092: INFO: kube-proxy-bootstrap-e2e-minion-group-fx4h started at 2022-11-26 07:09:42 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container kube-proxy ready: false, restart count 7
Nov 26 07:29:31.092: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-t94rt started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost-container ready: true, restart count 6
Nov 26 07:29:31.092: INFO: e2e-host-exec started at 2022-11-26 07:23:35 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container e2e-host-exec ready: true, restart count 1
Nov 26 07:29:31.092: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-vk4nw started at 2022-11-26 07:24:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost-container ready: false, restart count 3
Nov 26 07:29:31.092: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-k4crh started at 2022-11-26 07:11:49 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost-container ready: false, restart count 4
Nov 26 07:29:31.092: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:19:20 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-attacher ready: true, restart count 1
Nov 26 07:29:31.092: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:12 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-attacher ready: true, restart count 4
Nov 26 07:29:31.092: INFO: pod3 started at 2022-11-26 07:23:32 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost ready: true, restart count 3
Nov 26 07:29:31.092: INFO: test-pod-1 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container token-test ready: false, restart count 0
Nov 26 07:29:31.092: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:17:10 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-attacher ready: false, restart count 5
Nov 26 07:29:31.092: INFO: Container csi-provisioner ready: false, restart count 5
Nov 26 07:29:31.092: INFO: Container csi-resizer ready: false, restart count 5
Nov 26 07:29:31.092: INFO: Container csi-snapshotter ready: false, restart count 5
Nov 26 07:29:31.092: INFO: Container hostpath ready: false, restart count 5
Nov 26 07:29:31.092: INFO: Container liveness-probe ready: false, restart count 5
Nov 26 07:29:31.092: INFO: Container node-driver-registrar ready: false, restart count 5
Nov 26 07:29:31.092: INFO: up-down-2-w26j5 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container up-down-2 ready: true, restart count 4
Nov 26 07:29:31.092: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:19:23 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-attacher ready: true, restart count 5
Nov 26 07:29:31.092: INFO: Container csi-provisioner ready: true, restart count 5
Nov 26 07:29:31.092: INFO: Container csi-resizer ready: true, restart count 5
Nov 26 07:29:31.092: INFO: Container csi-snapshotter ready: true, restart count 5
Nov 26 07:29:31.092: INFO: Container hostpath ready: true, restart count 5
Nov 26 07:29:31.092: INFO: Container liveness-probe ready: true, restart count 5
Nov 26 07:29:31.092: INFO: Container node-driver-registrar ready: true, restart count 5
Nov 26 07:29:31.092: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-hrfdg started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost-container ready: true, restart count 5
Nov 26 07:29:31.092: INFO: pod1 started at 2022-11-26 07:23:26 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost ready: true, restart count 1
Nov 26 07:29:31.092: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:03 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-provisioner ready: false, restart count 6
Nov 26 07:29:31.092: INFO: Container driver-registrar ready: false, restart count 6
Nov 26 07:29:31.092: INFO: Container mock ready: false, restart count 6
Nov 26 07:29:31.092: INFO: kube-dns-autoscaler-5f6455f985-mr42t started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container autoscaler ready: true, restart count 7
Nov 26 07:29:31.092: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:12 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:29:31.092: INFO: Container driver-registrar ready: true, restart count 4
Nov 26 07:29:31.092: INFO: Container mock ready: true, restart count 4
Nov 26 07:29:31.092: INFO: l7-default-backend-8549d69d99-wf7s6 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container default-http-backend ready: true, restart count 0
Nov 26 07:29:31.092: INFO: pod2 started at 2022-11-26 07:23:30 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost ready: false, restart count 4
Nov 26 07:29:31.092: INFO: pod-subpath-test-preprovisionedpv-snzn started at 2022-11-26 07:12:03 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Init container init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:29:31.092: INFO: Init container test-init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:29:31.092: INFO: Container test-container-subpath-preprovisionedpv-snzn ready: false, restart count 0
Nov 26 07:29:31.092: INFO: pod-subpath-test-preprovisionedpv-tzwd started at 2022-11-26 07:12:04 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Init container init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:29:31.092: INFO: Init container test-init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:29:31.092: INFO: Container test-container-subpath-preprovisionedpv-tzwd ready: false, restart count 0
Nov 26 07:29:31.092: INFO: coredns-6d97d5ddb-r7jr7 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container coredns ready: false, restart count 7
Nov 26 07:29:31.092: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+4 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container busybox ready: false, restart count 6
Nov 26 07:29:31.092: INFO: Container csi-provisioner ready: false, restart count 6
Nov 26 07:29:31.092: INFO: Container driver-registrar ready: false, restart count 7
Nov 26 07:29:31.092: INFO: Container mock ready: false, restart count 7
Nov 26 07:29:31.092: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container csi-attacher ready: true, restart count 5
Nov 26 07:29:31.092: INFO: volume-snapshot-controller-0 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container volume-snapshot-controller ready: true, restart count 6
Nov 26 07:29:31.092: INFO: up-down-1-ghvx6 started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container up-down-1 ready: true, restart count 0
Nov 26 07:29:31.092: INFO: pod-configmaps-d8c89993-128a-416a-b57f-998af5485f65 started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.092: INFO: Container agnhost-container ready: false, restart count 0
Nov 26 07:29:31.367: INFO:
Latency metrics for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:29:31.367: INFO:
Logging node info for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:29:31.410: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 11032 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7726":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:28:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:28:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:28:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:28:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:28:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:29:31.411: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:29:31.456: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb
Nov 26 07:29:31.513: INFO: e2e-zp4g8-89zc8 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container c ready: false, restart count 0
Nov 26 07:29:31.513: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:11:52 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container csi-attacher ready: true, restart count 5
Nov 26 07:29:31.513: INFO: pod-1 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container donothing ready: true, restart count 5
Nov 26 07:29:31.513: INFO: konnectivity-agent-5cmvk started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container konnectivity-agent ready: false, restart count 6
Nov 26 07:29:31.513: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-7xqc7 started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container agnhost-container ready: false, restart count 6
Nov 26 07:29:31.513: INFO: coredns-6d97d5ddb-qnmdd started at 2022-11-26 07:10:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container coredns ready: true, restart count 8
Nov 26 07:29:31.513: INFO: test-pod-2 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container token-test ready: false, restart count 0
Nov 26 07:29:31.513: INFO: pod-0 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container donothing ready: true, restart count 5
Nov 26 07:29:31.513: INFO: pod-subpath-test-preprovisionedpv-xn2t started at 2022-11-26 07:12:04 +0000 UTC (1+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Init container init-volume-preprovisionedpv-xn2t ready: true, restart count 0
Nov 26 07:29:31.513: INFO: Container test-container-subpath-preprovisionedpv-xn2t ready: false, restart count 0
Nov 26 07:29:31.513: INFO: httpd started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container httpd ready: true, restart count 7
Nov 26 07:29:31.513: INFO: pod-2 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container donothing ready: true, restart count 4
Nov 26 07:29:31.513: INFO: up-down-2-9qgl7 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container up-down-2 ready: true, restart count 3
Nov 26 07:29:31.513: INFO: test-apparmor-88fsj started at 2022-11-26 07:23:50 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container test ready: false, restart count 0
Nov 26 07:29:31.513: INFO: pod-secrets-2fe85272-67c8-4ec5-8f6a-1601198e215a started at 2022-11-26 07:11:56 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container secret-volume-test ready: false, restart count 0
Nov 26 07:29:31.513: INFO: e2e-zp4g8-rlbsv started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container c ready: false, restart count 0
Nov 26 07:29:31.513: INFO: up-down-1-7kskn started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container up-down-1 ready: true, restart count 2
Nov 26 07:29:31.513: INFO: csi-mockplugin-0 started at 2022-11-26 07:23:47 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container csi-provisioner ready: true, restart count 5
Nov 26 07:29:31.513: INFO: Container driver-registrar ready: true, restart count 5
Nov 26 07:29:31.513: INFO: Container mock ready: true, restart count 5
Nov 26 07:29:31.513: INFO: metadata-proxy-v0.1-ztb2m started at 2022-11-26 07:09:44 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:29:31.513: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:29:31.513: INFO: affinity-nodeport-w6shs started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container affinity-nodeport ready: true, restart count 3
Nov 26 07:29:31.513: INFO: external-provisioner-hh2kt started at 2022-11-26 07:11:50 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container nfs-provisioner ready: true, restart count 5
Nov 26 07:29:31.513: INFO: pod-8975089f-4c51-4935-824c-48dec8be150b started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container write-pod ready: false, restart count 0
Nov 26 07:29:31.513: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container csi-provisioner ready: false, restart count 6
Nov 26 07:29:31.513: INFO: Container driver-registrar ready: false, restart count 6
Nov 26 07:29:31.513: INFO: Container mock ready: false, restart count 6
Nov 26 07:29:31.513: INFO: client-containers-176852e0-aa4f-4787-8c18-2f872553a326 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container agnhost-container ready: false, restart count 0
Nov 26 07:29:31.513: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-bnhs4 started at 2022-11-26 07:19:40 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container agnhost-container ready: true, restart count 3
Nov 26 07:29:31.513: INFO: apparmor-loader-95hjv started at 2022-11-26 07:23:39 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container apparmor-loader ready: true, restart count 0
Nov 26 07:29:31.513: INFO: kube-proxy-bootstrap-e2e-minion-group-s2jb started at 2022-11-26 07:09:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container kube-proxy ready: false, restart count 7
Nov 26 07:29:31.513: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-lsrjh started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:29:31.513: INFO: Container agnhost-container ready: true, restart count 3
Nov 26 07:29:31.734: INFO:
Latency metrics for node bootstrap-e2e-minion-group-s2jb
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-2323" for this suite. 11/26/22 07:29:31.734
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\spod\sand\sconfigmap\screation\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc001344a50, {0xc00139f170, 0x2c}, 0xc002f9d130, 0x20fb, 0x20fc)
test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
test/e2e/apimachinery/webhook.go:102 +0x226
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:14:02.821
Nov 26 07:14:02.821: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/26/22 07:14:02.822
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:14:03.013
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:14:03.119
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/26/22 07:14:03.537
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 07:14:03.786
STEP: Deploying the webhook pod 11/26/22 07:14:03.851
STEP: Wait for the deployment to be ready 11/26/22 07:14:03.997
Nov 26 07:14:04.165: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set
Nov 26 07:14:06.666: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:08.892: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:10.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:12.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:14.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:16.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:18.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:20.737: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:22.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:24.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:26.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:28.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:30.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:32.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:34.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:36.731: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:38.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:40.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:42.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:44.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:46.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:48.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:50.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:52.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:54.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:56.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:14:58.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:00.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:02.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:04.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:06.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:08.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:10.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:12.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:14.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:16.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:18.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:20.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:22.725: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:24.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:26.723: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:28.740: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:30.810: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:32.784: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:34.738: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:36.741: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:38.732: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:40.778: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:42.739: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:44.788: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:46.746: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:48.720: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:50.926: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:52.827: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:54.723: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:56.813: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:15:58.755: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:01.080: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:02.755: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:04.894: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:06.928: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:08.920: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:10.818: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:12.852: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:14.765: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:16.887: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:18.939: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:21.088: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:22.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:24.912: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:26.728: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:28.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:30.766: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:32.727: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:34.811: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:36.796: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:38.720: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:40.840: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:42.748: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:44.781: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:46.744: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:48.720: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:50.819: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:52.721: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:54.735: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:56.750: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:16:58.735: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:00.901: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:02.891: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:04.727: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:06.755: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:08.735: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:10.737: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:12.804: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:14.722: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:16.911: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:18.745: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:20.791: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:22.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:24.715: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:26.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:28.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:30.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:32.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:34.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:36.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:38.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:40.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:42.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:44.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:46.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:48.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:50.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:52.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:54.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:56.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:17:58.707: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:00.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:02.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:04.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:06.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:08.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:10.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:12.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:14.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:16.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:18.712: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:20.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:22.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:24.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:26.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:28.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:30.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:32.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:34.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:36.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:38.726: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:40.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:42.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:44.779: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:46.753: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:48.716: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:50.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:52.707: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:54.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:56.709: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:18:58.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:19:00.711: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:19:02.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
------------------------------
Progress Report for Ginkgo Process #22
Automatically polling progress:
[sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance] (Spec Runtime: 5m0.404s)
test/e2e/apimachinery/webhook.go:197
In [BeforeEach] (Node Runtime: 5m0.001s)
test/e2e/apimachinery/webhook.go:90
At [By Step] Wait for the deployment to be ready (Step Runtime: 4m59.227s)
test/e2e/apimachinery/webhook.go:822
Spec Goroutine
goroutine 124 [select]
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0000820c8}, 0xc000afcb88, 0x2fdb16a?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:660
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0000820c8}, 0x40?, 0x2fd9d05?, 0x40?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe0bc8, 0xc0000820c8}, 0xc001857700?, 0xc00396fc90?, 0x262a967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x262a61f?, 0x66e4640?, 0x40?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514
k8s.io/kubernetes/test/utils.waitForDeploymentCompleteMaybeCheckRolling({0x801de88?, 0xc0043beea0}, 0xc00447b400, 0x0, 0x78959b8, 0xc0043beea0?, 0xc0032365f0?)
test/utils/deployment.go:82
k8s.io/kubernetes/test/utils.WaitForDeploymentComplete(...)
test/utils/deployment.go:201
k8s.io/kubernetes/test/e2e/framework/deployment.WaitForDeploymentComplete(...)
test/e2e/framework/deployment/wait.go:46
> k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc001344a50, {0xc00139f170, 0x2c}, 0xc002f9d130, 0x20fb, 0x20fc)
test/e2e/apimachinery/webhook.go:825
> k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
test/e2e/apimachinery/webhook.go:102
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc00382e3f0, 0xc0036e7140})
vendor/github.com/onsi/ginkgo/v2/internal/node.go:449
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738
------------------------------
Nov 26 07:19:04.710: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:19:06.708: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:19:06.750: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:19:06.751: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-2615):
<*errors.errorString | 0xc00184c2f0>: {
s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-webhook-deployment-865554f4d9\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}",
}
Nov 26 07:19:06.751: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-2615): error waiting for deployment "sample-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 14, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc001344a50, {0xc00139f170, 0x2c}, 0xc002f9d130, 0x20fb, 0x20fc)
test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
test/e2e/apimachinery/webhook.go:102 +0x226
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 26 07:19:06.751: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:19:06.988
STEP: Collecting events from namespace "webhook-2615". 11/26/22 07:19:06.988
STEP: Found 15 events. 11/26/22 07:19:07.032
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:04 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:04 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-6b9lb
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:04 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {default-scheduler } Scheduled: Successfully assigned webhook-2615/sample-webhook-deployment-865554f4d9-6b9lb to bootstrap-e2e-minion-group-dwd8
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:06 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:06 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Created: Created container sample-webhook
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:06 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Started: Started container sample-webhook
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:06 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.87:8444/readyz": dial tcp 10.64.3.87:8444: connect: connection refused
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:07 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Killing: Stopping container sample-webhook
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:08 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} SandboxChanged: Pod sandbox changed, it will be killed and re-created.
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.92:8444/readyz": EOF
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:09 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.87:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:11 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.92:8444/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:11 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} BackOff: Back-off restarting failed container sample-webhook in pod sample-webhook-deployment-865554f4d9-6b9lb_webhook-2615(cdeb064e-de75-4159-8754-9a7e7cb0bf7e)
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:28 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.93:8444/readyz": EOF
Nov 26 07:19:07.032: INFO: At 2022-11-26 07:14:29 +0000 UTC - event for sample-webhook-deployment-865554f4d9-6b9lb: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.93:8444/readyz": dial tcp 10.64.3.93:8444: i/o timeout
Nov 26 07:19:07.076: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 26 07:19:07.076: INFO: sample-webhook-deployment-865554f4d9-6b9lb bootstrap-e2e-minion-group-dwd8 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 07:14:04 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 07:17:15 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-11-26 07:17:15 +0000 UTC ContainersNotReady containers with unready status: [sample-webhook]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-11-26 07:14:04 +0000 UTC }]
Nov 26 07:19:07.076: INFO:
Nov 26 07:19:07.175: INFO:
Logging node info for node bootstrap-e2e-master
Nov 26 07:19:07.220: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 4725 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:15:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:19:07.220: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 26 07:19:07.266: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 26 07:19:07.321: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container etcd-container ready: true, restart count 0
Nov 26 07:19:07.321: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container konnectivity-server-container ready: true, restart count 1
Nov 26 07:19:07.321: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container kube-apiserver ready: true, restart count 1
Nov 26 07:19:07.321: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container kube-scheduler ready: true, restart count 2
Nov 26 07:19:07.321: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container kube-addon-manager ready: true, restart count 0
Nov 26 07:19:07.321: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container etcd-container ready: true, restart count 1
Nov 26 07:19:07.321: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container kube-controller-manager ready: true, restart count 5
Nov 26 07:19:07.321: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container l7-lb-controller ready: true, restart count 4
Nov 26 07:19:07.321: INFO: metadata-proxy-v0.1-c2shf started at 2022-11-26 07:10:15 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:19:07.321: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:19:07.321: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:19:07.511: INFO:
Latency metrics for node bootstrap-e2e-master
Nov 26 07:19:07.511: INFO:
Logging node info for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:19:07.555: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 7714 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-106":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-ephemeral-5439":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:13:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:14:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:18:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:14:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:14:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:14:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:14:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-9655^46036c60-6d5a-11ed-a3cd-726c96e55273],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:19:07.555: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:19:07.601: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8
Nov 26 07:19:07.672: INFO: dns-test-0ba045f1-c7d2-45f8-8fe7-f9cc1f5f517c started at 2022-11-26 07:16:49 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container jessie-querier ready: true, restart count 3
Nov 26 07:19:07.672: INFO: Container querier ready: true, restart count 3
Nov 26 07:19:07.672: INFO: Container webserver ready: true, restart count 3
Nov 26 07:19:07.672: INFO: netserver-0 started at 2022-11-26 07:16:26 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container webserver ready: true, restart count 3
Nov 26 07:19:07.672: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:13:28 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container csi-attacher ready: true, restart count 0
Nov 26 07:19:07.672: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:25 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container csi-attacher ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container csi-provisioner ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container csi-resizer ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container csi-snapshotter ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container hostpath ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container liveness-probe ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 26 07:19:07.672: INFO: startup-fc6006e4-686d-41a6-b7a8-ef7d8b2704d3 started at 2022-11-26 07:16:33 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container busybox ready: false, restart count 2
Nov 26 07:19:07.672: INFO: inline-volume-tester2-pjd8m started at 2022-11-26 07:16:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container csi-volume-tester ready: false, restart count 0
Nov 26 07:19:07.672: INFO: e2e-zp4g8-hrbcn started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container c ready: false, restart count 0
Nov 26 07:19:07.672: INFO: inline-volume-tester-7vfrm started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container csi-volume-tester ready: false, restart count 0
Nov 26 07:19:07.672: INFO: pod-sharedvolume-9c54a94f-2e8b-4047-8a9d-6d3f2703d5d1 started at 2022-11-26 07:16:51 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container busybox-main-container ready: false, restart count 0
Nov 26 07:19:07.672: INFO: Container busybox-sub-container ready: false, restart count 0
Nov 26 07:19:07.672: INFO: netserver-0 started at 2022-11-26 07:13:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container webserver ready: true, restart count 4
Nov 26 07:19:07.672: INFO: external-provisioner-6zv6g started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container nfs-provisioner ready: true, restart count 4
Nov 26 07:19:07.672: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:54 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container csi-attacher ready: true, restart count 2
Nov 26 07:19:07.672: INFO: Container csi-provisioner ready: true, restart count 2
Nov 26 07:19:07.672: INFO: Container csi-resizer ready: true, restart count 2
Nov 26 07:19:07.672: INFO: Container csi-snapshotter ready: true, restart count 2
Nov 26 07:19:07.672: INFO: Container hostpath ready: true, restart count 2
Nov 26 07:19:07.672: INFO: Container liveness-probe ready: true, restart count 2
Nov 26 07:19:07.672: INFO: Container node-driver-registrar ready: true, restart count 3
Nov 26 07:19:07.672: INFO: konnectivity-agent-qfhtq started at 2022-11-26 07:10:07 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container konnectivity-agent ready: true, restart count 5
Nov 26 07:19:07.672: INFO: e2e-zp4g8-48r9k started at 2022-11-26 07:11:57 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container c ready: false, restart count 0
Nov 26 07:19:07.672: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:35 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container csi-attacher ready: true, restart count 4
Nov 26 07:19:07.672: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:19:07.672: INFO: Container csi-resizer ready: true, restart count 4
Nov 26 07:19:07.672: INFO: Container csi-snapshotter ready: true, restart count 4
Nov 26 07:19:07.672: INFO: Container hostpath ready: true, restart count 4
Nov 26 07:19:07.672: INFO: Container liveness-probe ready: true, restart count 4
Nov 26 07:19:07.672: INFO: Container node-driver-registrar ready: true, restart count 4
Nov 26 07:19:07.672: INFO: execpod-affinityj9z2l started at 2022-11-26 07:12:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:19:07.672: INFO: affinity-nodeport-pxjt4 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container affinity-nodeport ready: true, restart count 4
Nov 26 07:19:07.672: INFO: liveness-3f616ef9-51ad-4d5f-90e0-c4462285c73f started at 2022-11-26 07:15:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container agnhost-container ready: true, restart count 2
Nov 26 07:19:07.672: INFO: sample-webhook-deployment-865554f4d9-6b9lb started at 2022-11-26 07:14:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container sample-webhook ready: false, restart count 5
Nov 26 07:19:07.672: INFO: pod-a6afd542-45da-48fe-a5d6-c1da3e4713cc started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container write-pod ready: false, restart count 0
Nov 26 07:19:07.672: INFO: csi-mockplugin-0 started at 2022-11-26 07:13:28 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container csi-provisioner ready: false, restart count 2
Nov 26 07:19:07.672: INFO: Container driver-registrar ready: false, restart count 2
Nov 26 07:19:07.672: INFO: Container mock ready: false, restart count 2
Nov 26 07:19:07.672: INFO: kube-proxy-bootstrap-e2e-minion-group-dwd8 started at 2022-11-26 07:09:52 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container kube-proxy ready: false, restart count 5
Nov 26 07:19:07.672: INFO: metadata-proxy-v0.1-hcl5n started at 2022-11-26 07:09:53 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:19:07.672: INFO: test-pod-3 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container token-test ready: false, restart count 0
Nov 26 07:19:07.672: INFO: concurrent-27824115-m2vzk started at 2022-11-26 07:15:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container c ready: true, restart count 1
Nov 26 07:19:07.672: INFO: concurrent-27824117-jllk8 started at 2022-11-26 07:17:00 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container c ready: true, restart count 1
Nov 26 07:19:07.672: INFO: test-container-pod started at 2022-11-26 07:17:26 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container webserver ready: true, restart count 2
Nov 26 07:19:07.672: INFO: inline-volume-ldhxf started at 2022-11-26 07:17:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container volume-tester ready: false, restart count 0
Nov 26 07:19:07.672: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-gcbfg started at 2022-11-26 07:11:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container sample-crd-conversion-webhook ready: true, restart count 5
Nov 26 07:19:07.672: INFO: metrics-server-v0.5.2-867b8754b9-zrfqf started at 2022-11-26 07:10:22 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container metrics-server ready: false, restart count 4
Nov 26 07:19:07.672: INFO: Container metrics-server-nanny ready: false, restart count 5
Nov 26 07:19:07.672: INFO: test-container-pod started at 2022-11-26 07:17:29 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container webserver ready: true, restart count 2
Nov 26 07:19:07.672: INFO: pod-handle-http-request started at 2022-11-26 07:16:09 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container container-handle-http-request ready: true, restart count 0
Nov 26 07:19:07.672: INFO: Container container-handle-https-request ready: true, restart count 0
Nov 26 07:19:07.672: INFO: implicit-nonroot-uid started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:07.672: INFO: Container implicit-nonroot-uid ready: false, restart count 0
Nov 26 07:19:07.960: INFO:
Latency metrics for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:19:07.960: INFO:
Logging node info for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:19:08.004: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 7816 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-4034":"bootstrap-e2e-minion-group-fx4h","csi-hostpath-volume-expand-7824":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4386":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4790":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 07:14:47 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:16:32 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 07:19:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:14:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:14:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:14:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:14:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:16:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:16:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:16:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:16:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:19:08.004: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:19:08.050: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h
Nov 26 07:19:08.118: INFO: metadata-proxy-v0.1-tm7ft started at 2022-11-26 07:09:43 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:19:08.118: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:19:08.118: INFO: konnectivity-agent-sznlb started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container konnectivity-agent ready: true, restart count 4
Nov 26 07:19:08.118: INFO: netserver-1 started at 2022-11-26 07:16:26 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container webserver ready: true, restart count 2
Nov 26 07:19:08.118: INFO: pod-0525a741-dd01-4230-ab87-046a3722256a started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container write-pod ready: true, restart count 0
Nov 26 07:19:08.118: INFO: affinity-nodeport-xkl85 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container affinity-nodeport ready: false, restart count 2
Nov 26 07:19:08.118: INFO: pvc-volume-tester-88r26 started at 2022-11-26 07:17:44 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container volume-tester ready: false, restart count 0
Nov 26 07:19:08.118: INFO: kube-proxy-bootstrap-e2e-minion-group-fx4h started at 2022-11-26 07:09:42 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container kube-proxy ready: false, restart count 5
Nov 26 07:19:08.118: INFO: netserver-1 started at 2022-11-26 07:13:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container webserver ready: true, restart count 5
Nov 26 07:19:08.118: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-t94rt started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container agnhost-container ready: true, restart count 3
Nov 26 07:19:08.118: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-k4crh started at 2022-11-26 07:11:49 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container agnhost-container ready: true, restart count 0
Nov 26 07:19:08.118: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:15:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-attacher ready: true, restart count 3
Nov 26 07:19:08.118: INFO: test-pod-1 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container token-test ready: false, restart count 0
Nov 26 07:19:08.118: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:17:10 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-attacher ready: true, restart count 1
Nov 26 07:19:08.118: INFO: Container csi-provisioner ready: true, restart count 1
Nov 26 07:19:08.118: INFO: Container csi-resizer ready: true, restart count 1
Nov 26 07:19:08.118: INFO: Container csi-snapshotter ready: true, restart count 1
Nov 26 07:19:08.118: INFO: Container hostpath ready: true, restart count 1
Nov 26 07:19:08.118: INFO: Container liveness-probe ready: true, restart count 1
Nov 26 07:19:08.118: INFO: Container node-driver-registrar ready: true, restart count 1
Nov 26 07:19:08.118: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:12 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-attacher ready: true, restart count 0
Nov 26 07:19:08.118: INFO: pod-8080f90d-29f8-4d6c-87f1-8f6bf2ea848f started at 2022-11-26 07:16:56 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container write-pod ready: false, restart count 0
Nov 26 07:19:08.118: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-hrfdg started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:19:08.118: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:53 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-attacher ready: true, restart count 2
Nov 26 07:19:08.118: INFO: Container csi-provisioner ready: true, restart count 2
Nov 26 07:19:08.118: INFO: Container csi-resizer ready: true, restart count 2
Nov 26 07:19:08.118: INFO: Container csi-snapshotter ready: true, restart count 2
Nov 26 07:19:08.118: INFO: Container hostpath ready: true, restart count 2
Nov 26 07:19:08.118: INFO: Container liveness-probe ready: true, restart count 2
Nov 26 07:19:08.118: INFO: Container node-driver-registrar ready: true, restart count 2
Nov 26 07:19:08.118: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-chkjz started at 2022-11-26 07:16:51 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container agnhost-container ready: false, restart count 3
Nov 26 07:19:08.118: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:03 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:19:08.118: INFO: Container driver-registrar ready: true, restart count 4
Nov 26 07:19:08.118: INFO: Container mock ready: true, restart count 4
Nov 26 07:19:08.118: INFO: kube-dns-autoscaler-5f6455f985-mr42t started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container autoscaler ready: false, restart count 4
Nov 26 07:19:08.118: INFO: l7-default-backend-8549d69d99-wf7s6 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container default-http-backend ready: true, restart count 0
Nov 26 07:19:08.118: INFO: csi-mockplugin-0 started at 2022-11-26 07:15:43 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-provisioner ready: false, restart count 3
Nov 26 07:19:08.118: INFO: Container driver-registrar ready: false, restart count 3
Nov 26 07:19:08.118: INFO: Container mock ready: false, restart count 3
Nov 26 07:19:08.118: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:12 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-provisioner ready: true, restart count 0
Nov 26 07:19:08.118: INFO: Container driver-registrar ready: true, restart count 0
Nov 26 07:19:08.118: INFO: Container mock ready: true, restart count 0
Nov 26 07:19:08.118: INFO: coredns-6d97d5ddb-r7jr7 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container coredns ready: false, restart count 5
Nov 26 07:19:08.118: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+4 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container busybox ready: false, restart count 4
Nov 26 07:19:08.118: INFO: Container csi-provisioner ready: false, restart count 4
Nov 26 07:19:08.118: INFO: Container driver-registrar ready: false, restart count 5
Nov 26 07:19:08.118: INFO: Container mock ready: false, restart count 5
Nov 26 07:19:08.118: INFO: pod-subpath-test-preprovisionedpv-snzn started at 2022-11-26 07:12:03 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Init container init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:19:08.118: INFO: Init container test-init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:19:08.118: INFO: Container test-container-subpath-preprovisionedpv-snzn ready: false, restart count 0
Nov 26 07:19:08.118: INFO: pod-subpath-test-preprovisionedpv-tzwd started at 2022-11-26 07:12:04 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Init container init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:19:08.118: INFO: Init container test-init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:19:08.118: INFO: Container test-container-subpath-preprovisionedpv-tzwd ready: false, restart count 0
Nov 26 07:19:08.118: INFO: volume-snapshot-controller-0 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container volume-snapshot-controller ready: true, restart count 5
Nov 26 07:19:08.118: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container csi-attacher ready: true, restart count 2
Nov 26 07:19:08.118: INFO: pod-configmaps-d8c89993-128a-416a-b57f-998af5485f65 started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:19:08.118: INFO: Container agnhost-container ready: true, restart count 0
Nov 26 07:19:08.382: INFO:
Latency metrics for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:19:08.382: INFO:
Logging node info for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:19:08.424: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 7554 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-3326":"bootstrap-e2e-minion-group-s2jb","csi-hostpath-volumemode-99":"bootstrap-e2e-minion-group-s2jb","csi-mock-csi-mock-volumes-4538":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-11-26 07:14:45 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 07:18:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:45 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:45 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:14:45 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:14:45 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:14:45 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:14:45 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:14:45 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:14:19 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:14:19 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:14:19 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:14:19 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:19:08.425: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:19:08.470: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb
Nov 26 07:19:38.516: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-s2jb: error trying to reach service: context deadline exceeded: connection error: desc = "transport: Error while dialing dial unix /etc/srv/kubernetes/konnectivity-server/konnectivity-server.socket: connect: no such file or directory"
STEP: Collecting events from namespace "webhook-2615-markers". 11/26/22 07:19:38.516
STEP: Found 0 events. 11/26/22 07:19:44.784
Nov 26 07:19:44.834: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 26 07:19:44.834: INFO:
Nov 26 07:19:44.912: INFO:
Logging node info for node bootstrap-e2e-master
Nov 26 07:19:44.982: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 4725 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:15:43 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:15:43 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:19:44.982: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 26 07:19:45.144: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 26 07:20:02.023: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container etcd-container ready: true, restart count 0
Nov 26 07:20:02.023: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container konnectivity-server-container ready: true, restart count 2
Nov 26 07:20:02.023: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container kube-apiserver ready: true, restart count 1
Nov 26 07:20:02.023: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container kube-scheduler ready: true, restart count 2
Nov 26 07:20:02.023: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container kube-addon-manager ready: true, restart count 0
Nov 26 07:20:02.023: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container etcd-container ready: true, restart count 2
Nov 26 07:20:02.023: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container kube-controller-manager ready: true, restart count 5
Nov 26 07:20:02.023: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container l7-lb-controller ready: true, restart count 4
Nov 26 07:20:02.023: INFO: metadata-proxy-v0.1-c2shf started at 2022-11-26 07:10:15 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:20:02.023: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:20:02.023: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:20:03.229: INFO:
Latency metrics for node bootstrap-e2e-master
Nov 26 07:20:03.229: INFO:
Logging node info for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:20:03.278: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 8468 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-106":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-ephemeral-5439":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:19:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-11-26 07:19:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-26 07:19:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-9655^46036c60-6d5a-11ed-a3cd-726c96e55273],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-9655^46036c60-6d5a-11ed-a3cd-726c96e55273,DevicePath:,},},Config:nil,},}
Nov 26 07:20:03.279: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:20:03.327: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8
Nov 26 07:20:03.400: INFO: affinity-nodeport-pxjt4 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.400: INFO: Container affinity-nodeport ready: true, restart count 4
Nov 26 07:20:03.400: INFO: execpod-affinityj9z2l started at 2022-11-26 07:12:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.400: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:20:03.400: INFO: pod-update-activedeadlineseconds-5955fd5a-b020-4868-bf7d-f791bacdcebd started at 2022-11-26 07:19:19 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container pause ready: false, restart count 1
Nov 26 07:20:03.401: INFO: pod-a6afd542-45da-48fe-a5d6-c1da3e4713cc started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container write-pod ready: false, restart count 0
Nov 26 07:20:03.401: INFO: kube-proxy-bootstrap-e2e-minion-group-dwd8 started at 2022-11-26 07:09:52 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container kube-proxy ready: false, restart count 5
Nov 26 07:20:03.401: INFO: metadata-proxy-v0.1-hcl5n started at 2022-11-26 07:09:53 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:20:03.401: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:20:03.401: INFO: test-pod-3 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container token-test ready: false, restart count 0
Nov 26 07:20:03.401: INFO: concurrent-27824120-jkn4h started at 2022-11-26 07:20:00 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container c ready: true, restart count 0
Nov 26 07:20:03.401: INFO: metrics-server-v0.5.2-867b8754b9-zrfqf started at 2022-11-26 07:10:22 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container metrics-server ready: false, restart count 5
Nov 26 07:20:03.401: INFO: Container metrics-server-nanny ready: false, restart count 5
Nov 26 07:20:03.401: INFO: pod-adoption-release-mnhs4 started at 2022-11-26 07:19:35 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container pod-adoption-release ready: false, restart count 0
Nov 26 07:20:03.401: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-gcbfg started at 2022-11-26 07:11:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container sample-crd-conversion-webhook ready: true, restart count 5
Nov 26 07:20:03.401: INFO: implicit-nonroot-uid started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container implicit-nonroot-uid ready: false, restart count 0
Nov 26 07:20:03.401: INFO: pfpod started at 2022-11-26 07:19:18 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container portforwardtester ready: false, restart count 0
Nov 26 07:20:03.401: INFO: Container readiness ready: false, restart count 0
Nov 26 07:20:03.401: INFO: dns-test-0ba045f1-c7d2-45f8-8fe7-f9cc1f5f517c started at 2022-11-26 07:16:49 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container jessie-querier ready: false, restart count 3
Nov 26 07:20:03.401: INFO: Container querier ready: false, restart count 3
Nov 26 07:20:03.401: INFO: Container webserver ready: false, restart count 3
Nov 26 07:20:03.401: INFO: concurrent-27824119-qmgc8 started at 2022-11-26 07:19:17 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container c ready: true, restart count 0
Nov 26 07:20:03.401: INFO: pod-adoption-release started at 2022-11-26 07:19:33 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container pod-adoption-release ready: true, restart count 0
Nov 26 07:20:03.401: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:25 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container csi-attacher ready: true, restart count 1
Nov 26 07:20:03.401: INFO: Container csi-provisioner ready: true, restart count 1
Nov 26 07:20:03.401: INFO: Container csi-resizer ready: true, restart count 1
Nov 26 07:20:03.401: INFO: Container csi-snapshotter ready: true, restart count 1
Nov 26 07:20:03.401: INFO: Container hostpath ready: true, restart count 1
Nov 26 07:20:03.401: INFO: Container liveness-probe ready: true, restart count 1
Nov 26 07:20:03.401: INFO: Container node-driver-registrar ready: true, restart count 1
Nov 26 07:20:03.401: INFO: e2e-zp4g8-hrbcn started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container c ready: false, restart count 0
Nov 26 07:20:03.401: INFO: inline-volume-tester-7vfrm started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container csi-volume-tester ready: false, restart count 0
Nov 26 07:20:03.401: INFO: external-provisioner-6zv6g started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container nfs-provisioner ready: true, restart count 4
Nov 26 07:20:03.401: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:54 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container csi-attacher ready: true, restart count 2
Nov 26 07:20:03.401: INFO: Container csi-provisioner ready: true, restart count 2
Nov 26 07:20:03.401: INFO: Container csi-resizer ready: true, restart count 2
Nov 26 07:20:03.401: INFO: Container csi-snapshotter ready: true, restart count 2
Nov 26 07:20:03.401: INFO: Container hostpath ready: true, restart count 2
Nov 26 07:20:03.401: INFO: Container liveness-probe ready: true, restart count 2
Nov 26 07:20:03.401: INFO: Container node-driver-registrar ready: true, restart count 3
Nov 26 07:20:03.401: INFO: konnectivity-agent-qfhtq started at 2022-11-26 07:10:07 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container konnectivity-agent ready: false, restart count 5
Nov 26 07:20:03.401: INFO: e2e-zp4g8-48r9k started at 2022-11-26 07:11:57 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container c ready: false, restart count 0
Nov 26 07:20:03.401: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:35 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:20:03.401: INFO: Container csi-attacher ready: true, restart count 4
Nov 26 07:20:03.401: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:20:03.401: INFO: Container csi-resizer ready: true, restart count 4
Nov 26 07:20:03.401: INFO: Container csi-snapshotter ready: true, restart count 4
Nov 26 07:20:03.401: INFO: Container hostpath ready: true, restart count 4
Nov 26 07:20:03.401: INFO: Container liveness-probe ready: true, restart count 4
Nov 26 07:20:03.401: INFO: Container node-driver-registrar ready: true, restart count 4
Nov 26 07:20:03.755: INFO:
Latency metrics for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:20:03.755: INFO:
Logging node info for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:20:03.799: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 8501 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8980":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4386":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4790":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9094":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9869":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 07:19:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 07:19:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:56 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:56 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:56 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:19:56 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8980^aa56e6de-6d5a-11ed-b154-7a7e378df9a8],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8980^aa56e6de-6d5a-11ed-b154-7a7e378df9a8,DevicePath:,},},Config:nil,},}
Nov 26 07:20:03.799: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:20:03.844: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h
Nov 26 07:20:03.908: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-hrfdg started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:20:03.908: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:03 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:20:03.908: INFO: Container driver-registrar ready: true, restart count 4
Nov 26 07:20:03.908: INFO: Container mock ready: true, restart count 4
Nov 26 07:20:03.908: INFO: kube-dns-autoscaler-5f6455f985-mr42t started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container autoscaler ready: false, restart count 4
Nov 26 07:20:03.908: INFO: l7-default-backend-8549d69d99-wf7s6 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container default-http-backend ready: true, restart count 0
Nov 26 07:20:03.908: INFO: csi-mockplugin-0 started at 2022-11-26 07:15:43 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:20:03.908: INFO: Container driver-registrar ready: true, restart count 4
Nov 26 07:20:03.908: INFO: Container mock ready: true, restart count 4
Nov 26 07:20:03.908: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:12 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container csi-provisioner ready: true, restart count 0
Nov 26 07:20:03.908: INFO: Container driver-registrar ready: true, restart count 0
Nov 26 07:20:03.908: INFO: Container mock ready: true, restart count 0
Nov 26 07:20:03.908: INFO: coredns-6d97d5ddb-r7jr7 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container coredns ready: false, restart count 5
Nov 26 07:20:03.908: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+4 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container busybox ready: false, restart count 4
Nov 26 07:20:03.908: INFO: Container csi-provisioner ready: false, restart count 5
Nov 26 07:20:03.908: INFO: Container driver-registrar ready: false, restart count 5
Nov 26 07:20:03.908: INFO: Container mock ready: false, restart count 5
Nov 26 07:20:03.908: INFO: pod-subpath-test-preprovisionedpv-snzn started at 2022-11-26 07:12:03 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Init container init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:20:03.908: INFO: Init container test-init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:20:03.908: INFO: Container test-container-subpath-preprovisionedpv-snzn ready: false, restart count 0
Nov 26 07:20:03.908: INFO: pod-subpath-test-preprovisionedpv-tzwd started at 2022-11-26 07:12:04 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Init container init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:20:03.908: INFO: Init container test-init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:20:03.908: INFO: Container test-container-subpath-preprovisionedpv-tzwd ready: false, restart count 0
Nov 26 07:20:03.908: INFO: volume-snapshot-controller-0 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container volume-snapshot-controller ready: true, restart count 5
Nov 26 07:20:03.908: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container csi-attacher ready: true, restart count 2
Nov 26 07:20:03.908: INFO: pod-configmaps-d8c89993-128a-416a-b57f-998af5485f65 started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container agnhost-container ready: false, restart count 0
Nov 26 07:20:03.908: INFO: metadata-proxy-v0.1-tm7ft started at 2022-11-26 07:09:43 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:20:03.908: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:20:03.908: INFO: konnectivity-agent-sznlb started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.908: INFO: Container konnectivity-agent ready: false, restart count 4
Nov 26 07:20:03.909: INFO: pod-0525a741-dd01-4230-ab87-046a3722256a started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container write-pod ready: true, restart count 0
Nov 26 07:20:03.909: INFO: affinity-nodeport-xkl85 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container affinity-nodeport ready: true, restart count 3
Nov 26 07:20:03.909: INFO: kube-proxy-bootstrap-e2e-minion-group-fx4h started at 2022-11-26 07:09:42 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container kube-proxy ready: false, restart count 6
Nov 26 07:20:03.909: INFO: csi-mockplugin-0 started at 2022-11-26 07:19:20 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container csi-provisioner ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container driver-registrar ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container mock ready: true, restart count 1
Nov 26 07:20:03.909: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-t94rt started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container agnhost-container ready: true, restart count 3
Nov 26 07:20:03.909: INFO: inline-volume-tester-bj4jv started at 2022-11-26 07:19:29 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container csi-volume-tester ready: true, restart count 0
Nov 26 07:20:03.909: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-k4crh started at 2022-11-26 07:11:49 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:20:03.909: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:19:20 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container csi-attacher ready: true, restart count 1
Nov 26 07:20:03.909: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:15:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container csi-attacher ready: true, restart count 3
Nov 26 07:20:03.909: INFO: test-pod-1 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container token-test ready: false, restart count 0
Nov 26 07:20:03.909: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:17:10 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container csi-attacher ready: false, restart count 1
Nov 26 07:20:03.909: INFO: Container csi-provisioner ready: false, restart count 1
Nov 26 07:20:03.909: INFO: Container csi-resizer ready: false, restart count 1
Nov 26 07:20:03.909: INFO: Container csi-snapshotter ready: false, restart count 1
Nov 26 07:20:03.909: INFO: Container hostpath ready: false, restart count 1
Nov 26 07:20:03.909: INFO: Container liveness-probe ready: false, restart count 1
Nov 26 07:20:03.909: INFO: Container node-driver-registrar ready: false, restart count 1
Nov 26 07:20:03.909: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:12 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container csi-attacher ready: true, restart count 0
Nov 26 07:20:03.909: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:19:23 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:20:03.909: INFO: Container csi-attacher ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container csi-provisioner ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container csi-resizer ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container csi-snapshotter ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container hostpath ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container liveness-probe ready: true, restart count 1
Nov 26 07:20:03.909: INFO: Container node-driver-registrar ready: true, restart count 1
Nov 26 07:20:04.189: INFO:
Latency metrics for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:20:04.189: INFO:
Logging node info for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:20:04.232: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 8523 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-99":"bootstrap-e2e-minion-group-s2jb","csi-mock-csi-mock-volumes-4538":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:19:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:19:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:20:04.233: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:20:04.284: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb
Nov 26 07:20:04.356: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:14 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container csi-attacher ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container csi-provisioner ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container csi-resizer ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container csi-snapshotter ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container hostpath ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container liveness-probe ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container node-driver-registrar ready: true, restart count 0
Nov 26 07:20:04.356: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:20:04.356: INFO: Container driver-registrar ready: true, restart count 4
Nov 26 07:20:04.356: INFO: Container mock ready: true, restart count 4
Nov 26 07:20:04.356: INFO: client-containers-176852e0-aa4f-4787-8c18-2f872553a326 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container agnhost-container ready: false, restart count 0
Nov 26 07:20:04.356: INFO: dns-test-66bf7ab2-c126-4d84-b98a-048a34dc2baa started at 2022-11-26 07:15:58 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container jessie-querier ready: true, restart count 1
Nov 26 07:20:04.356: INFO: Container querier ready: true, restart count 1
Nov 26 07:20:04.356: INFO: Container webserver ready: true, restart count 1
Nov 26 07:20:04.356: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-bnhs4 started at 2022-11-26 07:19:40 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container agnhost-container ready: true, restart count 0
Nov 26 07:20:04.356: INFO: kube-proxy-bootstrap-e2e-minion-group-s2jb started at 2022-11-26 07:09:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container kube-proxy ready: false, restart count 5
Nov 26 07:20:04.356: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-lsrjh started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:20:04.356: INFO: e2e-zp4g8-89zc8 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container c ready: false, restart count 0
Nov 26 07:20:04.356: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:11:52 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container csi-attacher ready: false, restart count 4
Nov 26 07:20:04.356: INFO: pod-1 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container donothing ready: true, restart count 3
Nov 26 07:20:04.356: INFO: konnectivity-agent-5cmvk started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container konnectivity-agent ready: true, restart count 5
Nov 26 07:20:04.356: INFO: dns-test-9f206a1d-f53c-4783-9c4d-78871004081e started at 2022-11-26 07:16:06 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container jessie-querier ready: true, restart count 2
Nov 26 07:20:04.356: INFO: Container querier ready: true, restart count 2
Nov 26 07:20:04.356: INFO: Container webserver ready: true, restart count 2
Nov 26 07:20:04.356: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-7xqc7 started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container agnhost-container ready: false, restart count 2
Nov 26 07:20:04.356: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:14:00 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container csi-attacher ready: false, restart count 5
Nov 26 07:20:04.356: INFO: Container csi-provisioner ready: false, restart count 5
Nov 26 07:20:04.356: INFO: Container csi-resizer ready: false, restart count 5
Nov 26 07:20:04.356: INFO: Container csi-snapshotter ready: false, restart count 5
Nov 26 07:20:04.356: INFO: Container hostpath ready: false, restart count 5
Nov 26 07:20:04.356: INFO: Container liveness-probe ready: false, restart count 5
Nov 26 07:20:04.356: INFO: Container node-driver-registrar ready: false, restart count 5
Nov 26 07:20:04.356: INFO: coredns-6d97d5ddb-qnmdd started at 2022-11-26 07:10:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container coredns ready: false, restart count 6
Nov 26 07:20:04.356: INFO: test-pod-2 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container token-test ready: false, restart count 0
Nov 26 07:20:04.356: INFO: pod-0 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container donothing ready: false, restart count 3
Nov 26 07:20:04.356: INFO: pod-subpath-test-preprovisionedpv-xn2t started at 2022-11-26 07:12:04 +0000 UTC (1+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Init container init-volume-preprovisionedpv-xn2t ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container test-container-subpath-preprovisionedpv-xn2t ready: false, restart count 0
Nov 26 07:20:04.356: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-mzlfl started at 2022-11-26 07:19:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:20:04.356: INFO: httpd started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container httpd ready: true, restart count 4
Nov 26 07:20:04.356: INFO: pod-2 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container donothing ready: true, restart count 2
Nov 26 07:20:04.356: INFO: pod-secrets-2fe85272-67c8-4ec5-8f6a-1601198e215a started at 2022-11-26 07:11:56 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container secret-volume-test ready: false, restart count 0
Nov 26 07:20:04.356: INFO: e2e-zp4g8-rlbsv started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container c ready: false, restart count 0
Nov 26 07:20:04.356: INFO: metadata-proxy-v0.1-ztb2m started at 2022-11-26 07:09:44 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:20:04.356: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:20:04.356: INFO: affinity-nodeport-w6shs started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container affinity-nodeport ready: true, restart count 2
Nov 26 07:20:04.356: INFO: external-provisioner-hh2kt started at 2022-11-26 07:11:50 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container nfs-provisioner ready: true, restart count 3
Nov 26 07:20:04.356: INFO: pod-8975089f-4c51-4935-824c-48dec8be150b started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:20:04.356: INFO: Container write-pod ready: false, restart count 0
Nov 26 07:20:04.631: INFO:
Latency metrics for node bootstrap-e2e-minion-group-s2jb
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-2615" for this suite. 11/26/22 07:20:04.631
STEP: Destroying namespace "webhook-2615-markers" for this suite. 11/26/22 07:20:04.675
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\snot\sbe\sable\sto\smutate\sor\sprevent\sdeletion\sof\swebhook\sconfiguration\sobjects\s\[Conformance\]$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000737e00)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.cleanWebhookTest({0x0, 0x0}, {0x0, 0x0})
test/e2e/apimachinery/webhook.go:1680 +0x46
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.2()
test/e2e/apimachinery/webhook.go:106 +0x2f
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:25:34.499
Nov 26 07:25:34.499: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/26/22 07:25:34.5
Nov 26 07:25:34.539: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:25:36.580: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:25:38.580: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:25:40.579: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:25:42.579: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:25:44.579: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:25:46.579: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:25:48.579: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:27:55.308: INFO: Unexpected error:
<*fmt.wrapError | 0xc0001b0c20>: {
msg: "wait for service account \"default\" in namespace \"webhook-1345\": timed out waiting for the condition",
err: <*errors.errorString | 0xc000221c50>{
s: "timed out waiting for the condition",
},
}
Nov 26 07:27:55.308: FAIL: wait for service account "default" in namespace "webhook-1345": timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000737e00)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 26 07:27:55.309: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:27:55.415
STEP: Collecting events from namespace "webhook-1345". 11/26/22 07:27:55.416
STEP: Found 0 events. 11/26/22 07:27:55.473
Nov 26 07:27:55.531: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 26 07:27:55.531: INFO:
Nov 26 07:27:55.591: INFO:
Logging node info for node bootstrap-e2e-master
Nov 26 07:27:55.639: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 10560 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:25:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:27:55.639: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 26 07:27:55.850: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 26 07:27:56.495: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container konnectivity-server-container ready: true, restart count 3
Nov 26 07:27:56.495: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container kube-apiserver ready: true, restart count 2
Nov 26 07:27:56.495: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container kube-scheduler ready: true, restart count 3
Nov 26 07:27:56.495: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container kube-addon-manager ready: true, restart count 0
Nov 26 07:27:56.495: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container etcd-container ready: true, restart count 1
Nov 26 07:27:56.495: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container kube-controller-manager ready: false, restart count 6
Nov 26 07:27:56.495: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container l7-lb-controller ready: false, restart count 5
Nov 26 07:27:56.495: INFO: metadata-proxy-v0.1-c2shf started at 2022-11-26 07:10:15 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:27:56.495: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:27:56.495: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:56.495: INFO: Container etcd-container ready: true, restart count 2
Nov 26 07:27:57.393: INFO:
Latency metrics for node bootstrap-e2e-master
Nov 26 07:27:57.393: INFO:
Logging node info for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:27:57.438: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 10567 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:25:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:27:57.439: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:27:57.542: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8
Nov 26 07:27:57.999: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-gcbfg started at 2022-11-26 07:11:59 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container sample-crd-conversion-webhook ready: false, restart count 6
Nov 26 07:27:57.999: INFO: metrics-server-v0.5.2-867b8754b9-zrfqf started at 2022-11-26 07:10:22 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container metrics-server ready: false, restart count 6
Nov 26 07:27:57.999: INFO: Container metrics-server-nanny ready: false, restart count 7
Nov 26 07:27:57.999: INFO: up-down-1-ffjgt started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container up-down-1 ready: true, restart count 4
Nov 26 07:27:57.999: INFO: implicit-nonroot-uid started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container implicit-nonroot-uid ready: false, restart count 0
Nov 26 07:27:57.999: INFO: pfpod started at 2022-11-26 07:19:18 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container portforwardtester ready: false, restart count 0
Nov 26 07:27:57.999: INFO: Container readiness ready: false, restart count 0
Nov 26 07:27:57.999: INFO: concurrent-27824123-hdhlc started at 2022-11-26 07:23:22 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container c ready: true, restart count 3
Nov 26 07:27:57.999: INFO: e2e-zp4g8-hrbcn started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container c ready: false, restart count 0
Nov 26 07:27:57.999: INFO: verify-service-up-exec-pod-mf9vw started at 2022-11-26 07:23:51 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container agnhost-container ready: true, restart count 2
Nov 26 07:27:57.999: INFO: test-webserver-039afd23-9dac-425b-8ec3-492edeedba63 started at 2022-11-26 07:23:53 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container test-webserver ready: true, restart count 3
Nov 26 07:27:57.999: INFO: inline-volume-tester-7vfrm started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container csi-volume-tester ready: false, restart count 0
Nov 26 07:27:57.999: INFO: up-down-2-2pzwj started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container up-down-2 ready: false, restart count 3
Nov 26 07:27:57.999: INFO: external-provisioner-6zv6g started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container nfs-provisioner ready: false, restart count 6
Nov 26 07:27:57.999: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:54 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container csi-attacher ready: false, restart count 5
Nov 26 07:27:57.999: INFO: Container csi-provisioner ready: false, restart count 5
Nov 26 07:27:57.999: INFO: Container csi-resizer ready: false, restart count 5
Nov 26 07:27:57.999: INFO: Container csi-snapshotter ready: false, restart count 5
Nov 26 07:27:57.999: INFO: Container hostpath ready: false, restart count 5
Nov 26 07:27:57.999: INFO: Container liveness-probe ready: false, restart count 5
Nov 26 07:27:57.999: INFO: Container node-driver-registrar ready: false, restart count 5
Nov 26 07:27:57.999: INFO: konnectivity-agent-qfhtq started at 2022-11-26 07:10:07 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container konnectivity-agent ready: false, restart count 6
Nov 26 07:27:57.999: INFO: busybox-baf67443-54ea-47c6-98aa-71ed72364ec4 started at 2022-11-26 07:23:57 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container busybox ready: true, restart count 1
Nov 26 07:27:57.999: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:35 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container csi-attacher ready: true, restart count 4
Nov 26 07:27:57.999: INFO: Container csi-provisioner ready: true, restart count 4
Nov 26 07:27:57.999: INFO: Container csi-resizer ready: true, restart count 4
Nov 26 07:27:57.999: INFO: Container csi-snapshotter ready: true, restart count 4
Nov 26 07:27:57.999: INFO: Container hostpath ready: true, restart count 4
Nov 26 07:27:57.999: INFO: Container liveness-probe ready: true, restart count 4
Nov 26 07:27:57.999: INFO: Container node-driver-registrar ready: true, restart count 4
Nov 26 07:27:57.999: INFO: e2e-zp4g8-48r9k started at 2022-11-26 07:11:57 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container c ready: false, restart count 0
Nov 26 07:27:57.999: INFO: concurrent-27824124-tz2n7 started at 2022-11-26 07:24:00 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container c ready: true, restart count 2
Nov 26 07:27:57.999: INFO: execpod-affinityj9z2l started at 2022-11-26 07:12:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container agnhost-container ready: true, restart count 3
Nov 26 07:27:57.999: INFO: affinity-nodeport-pxjt4 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container affinity-nodeport ready: true, restart count 4
Nov 26 07:27:57.999: INFO: oidc-discovery-validator started at 2022-11-26 07:23:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container oidc-discovery-validator ready: false, restart count 0
Nov 26 07:27:57.999: INFO: pod-update-activedeadlineseconds-5955fd5a-b020-4868-bf7d-f791bacdcebd started at 2022-11-26 07:19:19 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container pause ready: false, restart count 1
Nov 26 07:27:57.999: INFO: test-pod-3 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container token-test ready: false, restart count 0
Nov 26 07:27:57.999: INFO: kube-proxy-bootstrap-e2e-minion-group-dwd8 started at 2022-11-26 07:09:52 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container kube-proxy ready: false, restart count 7
Nov 26 07:27:57.999: INFO: metadata-proxy-v0.1-hcl5n started at 2022-11-26 07:09:53 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:27:57.999: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:27:57.999: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:27:58.779: INFO:
Latency metrics for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:27:58.779: INFO:
Logging node info for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:27:58.826: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 10807 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8980":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4386":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4790":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9869":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:27:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:27:58.826: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:27:58.871: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h
Nov 26 07:27:59.272: INFO: pod-configmaps-d8c89993-128a-416a-b57f-998af5485f65 started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.272: INFO: Container agnhost-container ready: false, restart count 0
Nov 26 07:27:59.272: INFO: metadata-proxy-v0.1-tm7ft started at 2022-11-26 07:09:43 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:27:59.272: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:27:59.272: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:27:59.272: INFO: konnectivity-agent-sznlb started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.272: INFO: Container konnectivity-agent ready: true, restart count 6
Nov 26 07:27:59.272: INFO: pod-0525a741-dd01-4230-ab87-046a3722256a started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.272: INFO: Container write-pod ready: true, restart count 0
Nov 26 07:27:59.272: INFO: affinity-nodeport-xkl85 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.272: INFO: Container affinity-nodeport ready: false, restart count 5
Nov 26 07:27:59.272: INFO: kube-proxy-bootstrap-e2e-minion-group-fx4h started at 2022-11-26 07:09:42 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container kube-proxy ready: false, restart count 7
Nov 26 07:27:59.273: INFO: csi-mockplugin-0 started at 2022-11-26 07:19:20 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-provisioner ready: true, restart count 2
Nov 26 07:27:59.273: INFO: Container driver-registrar ready: true, restart count 2
Nov 26 07:27:59.273: INFO: Container mock ready: true, restart count 2
Nov 26 07:27:59.273: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-t94rt started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container agnhost-container ready: false, restart count 5
Nov 26 07:27:59.273: INFO: e2e-host-exec started at 2022-11-26 07:23:35 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container e2e-host-exec ready: true, restart count 1
Nov 26 07:27:59.273: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-k4crh started at 2022-11-26 07:11:49 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container agnhost-container ready: true, restart count 4
Nov 26 07:27:59.273: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:19:20 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-attacher ready: true, restart count 1
Nov 26 07:27:59.273: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-vk4nw started at 2022-11-26 07:24:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container agnhost-container ready: true, restart count 1
Nov 26 07:27:59.273: INFO: test-pod-1 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container token-test ready: false, restart count 0
Nov 26 07:27:59.273: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:17:10 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-attacher ready: false, restart count 5
Nov 26 07:27:59.273: INFO: Container csi-provisioner ready: false, restart count 5
Nov 26 07:27:59.273: INFO: Container csi-resizer ready: false, restart count 5
Nov 26 07:27:59.273: INFO: Container csi-snapshotter ready: false, restart count 5
Nov 26 07:27:59.273: INFO: Container hostpath ready: false, restart count 5
Nov 26 07:27:59.273: INFO: Container liveness-probe ready: false, restart count 5
Nov 26 07:27:59.273: INFO: Container node-driver-registrar ready: false, restart count 5
Nov 26 07:27:59.273: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:12 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-attacher ready: true, restart count 4
Nov 26 07:27:59.273: INFO: pod3 started at 2022-11-26 07:23:32 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container agnhost ready: true, restart count 1
Nov 26 07:27:59.273: INFO: up-down-2-w26j5 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container up-down-2 ready: true, restart count 4
Nov 26 07:27:59.273: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:19:23 +0000 UTC (0+7 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-attacher ready: true, restart count 5
Nov 26 07:27:59.273: INFO: Container csi-provisioner ready: true, restart count 5
Nov 26 07:27:59.273: INFO: Container csi-resizer ready: true, restart count 5
Nov 26 07:27:59.273: INFO: Container csi-snapshotter ready: true, restart count 5
Nov 26 07:27:59.273: INFO: Container hostpath ready: true, restart count 5
Nov 26 07:27:59.273: INFO: Container liveness-probe ready: true, restart count 5
Nov 26 07:27:59.273: INFO: Container node-driver-registrar ready: true, restart count 5
Nov 26 07:27:59.273: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-hrfdg started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container agnhost-container ready: false, restart count 4
Nov 26 07:27:59.273: INFO: pod1 started at 2022-11-26 07:23:26 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container agnhost ready: true, restart count 1
Nov 26 07:27:59.273: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:03 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-provisioner ready: true, restart count 6
Nov 26 07:27:59.273: INFO: Container driver-registrar ready: true, restart count 6
Nov 26 07:27:59.273: INFO: Container mock ready: true, restart count 6
Nov 26 07:27:59.273: INFO: kube-dns-autoscaler-5f6455f985-mr42t started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container autoscaler ready: false, restart count 6
Nov 26 07:27:59.273: INFO: l7-default-backend-8549d69d99-wf7s6 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container default-http-backend ready: true, restart count 0
Nov 26 07:27:59.273: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:12 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-provisioner ready: true, restart count 3
Nov 26 07:27:59.273: INFO: Container driver-registrar ready: true, restart count 3
Nov 26 07:27:59.273: INFO: Container mock ready: true, restart count 3
Nov 26 07:27:59.273: INFO: coredns-6d97d5ddb-r7jr7 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container coredns ready: false, restart count 7
Nov 26 07:27:59.273: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+4 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container busybox ready: true, restart count 6
Nov 26 07:27:59.273: INFO: Container csi-provisioner ready: false, restart count 6
Nov 26 07:27:59.273: INFO: Container driver-registrar ready: false, restart count 7
Nov 26 07:27:59.273: INFO: Container mock ready: false, restart count 7
Nov 26 07:27:59.273: INFO: pod2 started at 2022-11-26 07:23:30 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container agnhost ready: false, restart count 3
Nov 26 07:27:59.273: INFO: pod-subpath-test-preprovisionedpv-snzn started at 2022-11-26 07:12:03 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Init container init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:27:59.273: INFO: Init container test-init-volume-preprovisionedpv-snzn ready: true, restart count 0
Nov 26 07:27:59.273: INFO: Container test-container-subpath-preprovisionedpv-snzn ready: false, restart count 0
Nov 26 07:27:59.273: INFO: pod-subpath-test-preprovisionedpv-tzwd started at 2022-11-26 07:12:04 +0000 UTC (2+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Init container init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:27:59.273: INFO: Init container test-init-volume-preprovisionedpv-tzwd ready: true, restart count 0
Nov 26 07:27:59.273: INFO: Container test-container-subpath-preprovisionedpv-tzwd ready: false, restart count 0
Nov 26 07:27:59.273: INFO: volume-snapshot-controller-0 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container volume-snapshot-controller ready: true, restart count 6
Nov 26 07:27:59.273: INFO: up-down-1-ghvx6 started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container up-down-1 ready: true, restart count 0
Nov 26 07:27:59.273: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:27:59.273: INFO: Container csi-attacher ready: false, restart count 4
Nov 26 07:27:59.981: INFO:
Latency metrics for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:27:59.981: INFO:
Logging node info for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:28:00.037: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 10720 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7726":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:27:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:28:00.038: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:28:00.115: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb
Nov 26 07:28:00.481: INFO: up-down-2-9qgl7 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container up-down-2 ready: true, restart count 3
Nov 26 07:28:00.481: INFO: httpd started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container httpd ready: false, restart count 6
Nov 26 07:28:00.481: INFO: pod-2 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container donothing ready: true, restart count 4
Nov 26 07:28:00.481: INFO: test-apparmor-88fsj started at 2022-11-26 07:23:50 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container test ready: false, restart count 0
Nov 26 07:28:00.481: INFO: up-down-1-7kskn started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container up-down-1 ready: true, restart count 0
Nov 26 07:28:00.481: INFO: csi-mockplugin-0 started at 2022-11-26 07:23:47 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container csi-provisioner ready: true, restart count 5
Nov 26 07:28:00.481: INFO: Container driver-registrar ready: true, restart count 5
Nov 26 07:28:00.481: INFO: Container mock ready: true, restart count 5
Nov 26 07:28:00.481: INFO: pod-secrets-2fe85272-67c8-4ec5-8f6a-1601198e215a started at 2022-11-26 07:11:56 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container secret-volume-test ready: false, restart count 0
Nov 26 07:28:00.481: INFO: e2e-zp4g8-rlbsv started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container c ready: false, restart count 0
Nov 26 07:28:00.481: INFO: metadata-proxy-v0.1-ztb2m started at 2022-11-26 07:09:44 +0000 UTC (0+2 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container metadata-proxy ready: true, restart count 0
Nov 26 07:28:00.481: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Nov 26 07:28:00.481: INFO: pod-8975089f-4c51-4935-824c-48dec8be150b started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container write-pod ready: false, restart count 0
Nov 26 07:28:00.481: INFO: affinity-nodeport-w6shs started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container affinity-nodeport ready: true, restart count 3
Nov 26 07:28:00.481: INFO: external-provisioner-hh2kt started at 2022-11-26 07:11:50 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container nfs-provisioner ready: true, restart count 5
Nov 26 07:28:00.481: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+3 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container csi-provisioner ready: false, restart count 5
Nov 26 07:28:00.481: INFO: Container driver-registrar ready: true, restart count 6
Nov 26 07:28:00.481: INFO: Container mock ready: false, restart count 5
Nov 26 07:28:00.481: INFO: verify-service-up-host-exec-pod started at 2022-11-26 07:23:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container agnhost-container ready: true, restart count 4
Nov 26 07:28:00.481: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-bnhs4 started at 2022-11-26 07:19:40 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container agnhost-container ready: true, restart count 2
Nov 26 07:28:00.481: INFO: apparmor-loader-95hjv started at 2022-11-26 07:23:39 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container apparmor-loader ready: true, restart count 0
Nov 26 07:28:00.481: INFO: client-containers-176852e0-aa4f-4787-8c18-2f872553a326 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container agnhost-container ready: false, restart count 0
Nov 26 07:28:00.481: INFO: kube-proxy-bootstrap-e2e-minion-group-s2jb started at 2022-11-26 07:09:43 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container kube-proxy ready: true, restart count 7
Nov 26 07:28:00.481: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-lsrjh started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container agnhost-container ready: true, restart count 3
Nov 26 07:28:00.481: INFO: pod-1 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container donothing ready: true, restart count 4
Nov 26 07:28:00.481: INFO: e2e-zp4g8-89zc8 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container c ready: false, restart count 0
Nov 26 07:28:00.481: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:11:52 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container csi-attacher ready: true, restart count 5
Nov 26 07:28:00.481: INFO: konnectivity-agent-5cmvk started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container konnectivity-agent ready: false, restart count 6
Nov 26 07:28:00.481: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-7xqc7 started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container agnhost-container ready: false, restart count 6
Nov 26 07:28:00.481: INFO: pod-0 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container donothing ready: true, restart count 5
Nov 26 07:28:00.481: INFO: pod-subpath-test-preprovisionedpv-xn2t started at 2022-11-26 07:12:04 +0000 UTC (1+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Init container init-volume-preprovisionedpv-xn2t ready: true, restart count 0
Nov 26 07:28:00.481: INFO: Container test-container-subpath-preprovisionedpv-xn2t ready: false, restart count 0
Nov 26 07:28:00.481: INFO: coredns-6d97d5ddb-qnmdd started at 2022-11-26 07:10:04 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container coredns ready: false, restart count 7
Nov 26 07:28:00.481: INFO: test-pod-2 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded)
Nov 26 07:28:00.481: INFO: Container token-test ready: false, restart count 0
Nov 26 07:28:00.954: INFO:
Latency metrics for node bootstrap-e2e-minion-group-s2jb
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-1345" for this suite. 11/26/22 07:28:00.955
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sunconditionally\sreject\soperations\son\sfail\sclosed\swebhook\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:1257
k8s.io/kubernetes/test/e2e/apimachinery.registerFailClosedWebhook(0xc0008dde00, {0xc001bee600, 0xc}, 0x0?, 0x0?)
test/e2e/apimachinery/webhook.go:1257 +0x591
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.7()
test/e2e/apimachinery/webhook.go:240 +0x45
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:31:14.607
Nov 26 07:31:14.608: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename webhook 11/26/22 07:31:14.609
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:31:14.88
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:31:14.999
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
STEP: Setting up server cert 11/26/22 07:31:16.345
STEP: Create role binding to let webhook read extension-apiserver-authentication 11/26/22 07:31:17.134
STEP: Deploying the webhook pod 11/26/22 07:31:17.271
STEP: Wait for the deployment to be ready 11/26/22 07:31:17.483
Nov 26 07:31:17.683: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set
Nov 26 07:31:19.855: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:22.047: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:23.937: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:26.171: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:27.906: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:29.924: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:32.079: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:33.926: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:36.032: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:37.920: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:40.034: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:41.939: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:44.034: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:45.937: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:47.935: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:49.951: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:52.132: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:31:54.009: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 31, 17, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
STEP: Deploying the webhook service 11/26/22 07:31:55.95
STEP: Verifying the service has paired with the endpoint 11/26/22 07:31:56.146
Nov 26 07:31:57.147: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should unconditionally reject operations on fail closed webhook [Conformance]
test/e2e/apimachinery/webhook.go:239
STEP: Registering a webhook that server cannot talk to, with fail closed policy, via the AdmissionRegistration API 11/26/22 07:31:57.23
Nov 26 07:31:57.833: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:31:58.172: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:31:58.461: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:31:58.793: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:31:59.151: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:31:59.461: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:31:59.950: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:00.301: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:00.895: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:01.496: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:01.838: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:02.291: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:02.610: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:02.898: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:03.248: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:03.639: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:03.930: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:04.227: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:04.412: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:04.613: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:05.241: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:05.832: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:06.238: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:06.614: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:06.941: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:07.291: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:07.632: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:07.835: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:08.198: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:08.492: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:08.792: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:09.134: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:09.558: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:10.030: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:10.298: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:10.783: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:11.147: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:11.546: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:11.894: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:12.145: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:12.613: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:12.886: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:13.212: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:13.447: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:13.756: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:14.136: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:14.551: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:15.049: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:15.619: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:16.012: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:16.332: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:16.614: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:16.924: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:17.230: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:17.411: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:17.679: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:17.942: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:18.291: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:18.600: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:19.023: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:19.445: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:19.814: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:19.996: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:20.260: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:20.692: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:21.101: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:21.787: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:22.148: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:22.714: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:23.273: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:23.626: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:23.974: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:24.286: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:24.500: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:24.760: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:25.041: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:25.367: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:25.732: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:26.200: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:26.485: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:26.777: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:27.218: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:27.517: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:28.142: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:28.405: INFO: Waiting for webhook configuration to be ready...
Nov 26 07:32:28.405: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*errors.errorString | 0xc000215d70>: {
s: "timed out waiting for the condition",
}
Nov 26 07:32:28.405: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerFailClosedWebhook(0xc0008dde00, {0xc001bee600, 0xc}, 0x0?, 0x0?)
test/e2e/apimachinery/webhook.go:1257 +0x591
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.7()
test/e2e/apimachinery/webhook.go:240 +0x45
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 26 07:32:28.405: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:32:29.073
STEP: Collecting events from namespace "webhook-4411". 11/26/22 07:32:29.073
STEP: Found 11 events. 11/26/22 07:32:29.151
Nov 26 07:32:29.151: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: { } Scheduled: Successfully assigned webhook-4411/sample-webhook-deployment-865554f4d9-jtzxn to bootstrap-e2e-minion-group-dwd8
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:17 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:17 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-jtzxn
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:19 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} FailedMount: MountVolume.SetUp failed for volume "webhook-certs" : failed to sync secret cache: timed out waiting for the condition
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:32 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:32 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} Created: Created container sample-webhook
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:32 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} Started: Started container sample-webhook
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:32 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} Killing: Stopping container sample-webhook
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:33 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.186:8444/readyz": dial tcp 10.64.3.186:8444: connect: connection refused
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:33 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} SandboxChanged: Pod sandbox changed, it will be killed and re-created.
Nov 26 07:32:29.151: INFO: At 2022-11-26 07:31:38 +0000 UTC - event for sample-webhook-deployment-865554f4d9-jtzxn: {kubelet bootstrap-e2e-minion-group-dwd8} Unhealthy: Readiness probe failed: Get "https://10.64.3.198:8444/readyz": dial tcp 10.64.3.198:8444: connect: connection refused
Nov 26 07:32:29.209: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 26 07:32:29.209: INFO:
Nov 26 07:32:29.274: INFO:
Logging node info for node bootstrap-e2e-master
Nov 26 07:32:29.337: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 12835 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:31:01 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:32:29.337: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 26 07:32:29.394: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 26 07:32:29.534: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available
Nov 26 07:32:29.534: INFO:
Logging node info for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:32:29.621: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 14408 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-247":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-volume-2917":"bootstrap-e2e-minion-group-dwd8","csi-mock-csi-mock-volumes-2390":"bootstrap-e2e-minion-group-dwd8","csi-mock-csi-mock-volumes-5698":"bootstrap-e2e-minion-group-dwd8","csi-mock-csi-mock-volumes-6090":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 07:29:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:31:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 07:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2390^4660e3d6-6d5c-11ed-911d-6e669a48526c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-2390^4660e3d6-6d5c-11ed-911d-6e669a48526c,DevicePath:,},},Config:nil,},}
Nov 26 07:32:29.621: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:32:29.694: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8
Nov 26 07:32:29.782: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dwd8: error trying to reach service: No agent available
Nov 26 07:32:29.782: INFO:
Logging node info for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:32:29.842: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 14437 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:29:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:32:29.843: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:32:29.924: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h
Nov 26 07:32:30.041: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-fx4h: error trying to reach service: No agent available
Nov 26 07:32:30.041: INFO:
Logging node info for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:32:30.148: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 14500 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6688":"bootstrap-e2e-minion-group-s2jb","csi-hostpath-ephemeral-7817":"bootstrap-e2e-minion-group-s2jb","csi-mock-csi-mock-volumes-1068":"bootstrap-e2e-minion-group-s2jb","csi-mock-csi-mock-volumes-7726":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-11-26 07:29:47 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:31:12 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 07:32:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:32:30.148: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:32:30.227: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb
Nov 26 07:32:30.374: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-s2jb: error trying to reach service: No agent available
STEP: Collecting events from namespace "webhook-4411-markers". 11/26/22 07:32:30.374
STEP: Found 0 events. 11/26/22 07:32:30.459
Nov 26 07:32:30.552: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 26 07:32:30.552: INFO:
Nov 26 07:32:30.695: INFO:
Logging node info for node bootstrap-e2e-master
Nov 26 07:32:30.771: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 12835 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:31:01 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:31:01 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:32:30.771: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 26 07:32:30.825: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 26 07:32:30.948: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available
Nov 26 07:32:30.948: INFO:
Logging node info for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:32:31.082: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 14408 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-247":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-volume-2917":"bootstrap-e2e-minion-group-dwd8","csi-mock-csi-mock-volumes-2390":"bootstrap-e2e-minion-group-dwd8","csi-mock-csi-mock-volumes-5698":"bootstrap-e2e-minion-group-dwd8","csi-mock-csi-mock-volumes-6090":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 07:29:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:31:36 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 07:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:31:52 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2390^4660e3d6-6d5c-11ed-911d-6e669a48526c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-2390^4660e3d6-6d5c-11ed-911d-6e669a48526c,DevicePath:,},},Config:nil,},}
Nov 26 07:32:31.082: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:32:31.200: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8
Nov 26 07:32:31.342: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dwd8: error trying to reach service: No agent available
Nov 26 07:32:31.342: INFO:
Logging node info for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:32:31.442: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 14437 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:29:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:32:21 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:29:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:31:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:32:31.443: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:32:31.523: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h
Nov 26 07:32:31.703: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-fx4h: error trying to reach service: No agent available
Nov 26 07:32:31.703: INFO:
Logging node info for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:32:31.772: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 14500 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6688":"bootstrap-e2e-minion-group-s2jb","csi-hostpath-ephemeral-7817":"bootstrap-e2e-minion-group-s2jb","csi-mock-csi-mock-volumes-1068":"bootstrap-e2e-minion-group-s2jb","csi-mock-csi-mock-volumes-7726":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {node-problem-detector Update v1 2022-11-26 07:29:47 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:31:12 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 07:32:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:29:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:32:24 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:32:31.772: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:32:31.843: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb
Nov 26 07:32:32.164: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-s2jb: error trying to reach service: No agent available
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "webhook-4411" for this suite. 11/26/22 07:32:32.164
STEP: Destroying namespace "webhook-4411-markers" for this suite. 11/26/22 07:32:32.388
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceConversionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sconvert\sa\snon\shomogeneous\slist\sof\sCRs\s\[Conformance\]$'
test/e2e/apimachinery/crd_conversion_webhook.go:327
k8s.io/kubernetes/test/e2e/apimachinery.deployCustomResourceWebhookAndService(0xc0008dc870, {0xc0042ae1b0, 0x2c}, 0xc00372c6e0, 0x24e3, 0x24e4)
test/e2e/apimachinery/crd_conversion_webhook.go:327 +0xe19
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.1()
test/e2e/apimachinery/crd_conversion_webhook.go:136 +0x206
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:12:08.324: failed to list events in namespace "crd-webhook-4161": Get "https://34.83.149.76/api/v1/namespaces/crd-webhook-4161/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:12:08.364: Couldn't delete ns: "crd-webhook-4161": Delete "https://34.83.149.76/api/v1/namespaces/crd-webhook-4161": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/crd-webhook-4161", Err:(*net.OpError)(0xc00372d4f0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:11:58.694
Nov 26 07:11:58.694: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename crd-webhook 11/26/22 07:11:58.696
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:11:58.852
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:11:58.934
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/crd_conversion_webhook.go:128
STEP: Setting up server cert 11/26/22 07:11:59.021
STEP: Create role binding to let cr conversion webhook read extension-apiserver-authentication 11/26/22 07:11:59.537
STEP: Deploying the custom resource conversion webhook pod 11/26/22 07:11:59.581
STEP: Wait for the deployment to be ready 11/26/22 07:11:59.679
Nov 26 07:11:59.817: INFO: deployment "sample-crd-conversion-webhook-deployment" doesn't have the required revision set
Nov 26 07:12:02.046: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:12:04.121: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:12:06.092: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), LastTransitionTime:time.Date(2022, time.November, 26, 7, 11, 59, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Nov 26 07:12:08.087: INFO: Unexpected error: waiting for sample-crd-conversion-webhook-deployment deployment status valid:
<*errors.errorString | 0xc00130cea0>: {
s: "error waiting for deployment \"sample-crd-conversion-webhook-deployment\" status to match expectation: Get \"https://34.83.149.76/apis/apps/v1/namespaces/crd-webhook-4161/deployments/sample-crd-conversion-webhook-deployment\": dial tcp 34.83.149.76:443: connect: connection refused",
}
Nov 26 07:12:08.087: FAIL: waiting for sample-crd-conversion-webhook-deployment deployment status valid: error waiting for deployment "sample-crd-conversion-webhook-deployment" status to match expectation: Get "https://34.83.149.76/apis/apps/v1/namespaces/crd-webhook-4161/deployments/sample-crd-conversion-webhook-deployment": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployCustomResourceWebhookAndService(0xc0008dc870, {0xc0042ae1b0, 0x2c}, 0xc00372c6e0, 0x24e3, 0x24e4)
test/e2e/apimachinery/crd_conversion_webhook.go:327 +0xe19
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.1()
test/e2e/apimachinery/crd_conversion_webhook.go:136 +0x206
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Nov 26 07:12:08.087: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/crd_conversion_webhook.go:139
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:12:08.285
STEP: Collecting events from namespace "crd-webhook-4161". 11/26/22 07:12:08.285
Nov 26 07:12:08.324: INFO: Unexpected error: failed to list events in namespace "crd-webhook-4161":
<*url.Error | 0xc0034259b0>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/crd-webhook-4161/events",
Err: <*net.OpError | 0xc00432ad20>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc004419050>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc00050d160>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:08.324: FAIL: failed to list events in namespace "crd-webhook-4161": Get "https://34.83.149.76/api/v1/namespaces/crd-webhook-4161/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0043e85c0, {0xc000a6f6f0, 0x10})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc0005a01a0}, {0xc000a6f6f0, 0x10})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc0043e8650?, {0xc000a6f6f0?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0008dc870)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc00134e210?, 0xc00118dfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc003728708?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc00134e210?, 0x29449fc?}, {0xae73300?, 0xc00118df80?, 0xc0005b0910?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
STEP: Destroying namespace "crd-webhook-4161" for this suite. 11/26/22 07:12:08.325
Nov 26 07:12:08.364: FAIL: Couldn't delete ns: "crd-webhook-4161": Delete "https://34.83.149.76/api/v1/namespaces/crd-webhook-4161": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/crd-webhook-4161", Err:(*net.OpError)(0xc00372d4f0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc0008dc870)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc00134e120?, 0xc00414bfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc00134e120?, 0x0?}, {0xae73300?, 0x5?, 0xc003460cb0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceDefinition\sresources\s\[Privileged\:ClusterAdmin\]\sSimple\sCustomResourceDefinition\slisting\scustom\sresource\sdefinition\sobjects\sworks\s\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00117cc30) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:26:31.837 Nov 26 07:26:31.837: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename custom-resource-definition 11/26/22 07:26:31.838 Nov 26 07:28:31.886: INFO: Unexpected error: <*fmt.wrapError | 0xc0009c6000>: { msg: "wait for service account \"default\" in namespace \"custom-resource-definition-6826\": timed out waiting for the condition", err: <*errors.errorString | 0xc000193d50>{ s: "timed out waiting for the condition", }, } Nov 26 07:28:31.887: FAIL: wait for service account "default" in namespace "custom-resource-definition-6826": timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc00117cc30) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Nov 26 07:28:31.887: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:28:31.938 STEP: Collecting events from namespace "custom-resource-definition-6826". 11/26/22 07:28:31.939 STEP: Found 0 events. 11/26/22 07:28:31.98 Nov 26 07:28:32.023: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 07:28:32.023: INFO: Nov 26 07:28:32.075: INFO: Logging node info for node bootstrap-e2e-master Nov 26 07:28:32.116: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 10560 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:25:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:28:32.116: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 07:28:32.161: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 07:28:32.222: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container etcd-container ready: true, restart count 2 Nov 26 07:28:32.222: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container kube-controller-manager ready: false, restart count 6 Nov 26 07:28:32.222: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container l7-lb-controller ready: true, restart count 6 Nov 26 07:28:32.222: INFO: metadata-proxy-v0.1-c2shf started at 2022-11-26 07:10:15 +0000 UTC (0+2 container statuses recorded) Nov 26 07:28:32.222: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:28:32.222: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:28:32.222: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container etcd-container ready: true, restart count 1 Nov 26 07:28:32.222: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container konnectivity-server-container ready: true, restart count 3 Nov 26 07:28:32.222: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container kube-apiserver ready: true, restart count 2 Nov 26 07:28:32.222: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container kube-scheduler ready: true, restart count 4 Nov 26 07:28:32.222: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.222: INFO: Container kube-addon-manager ready: true, restart count 0 Nov 26 07:28:32.454: INFO: Latency metrics for node bootstrap-e2e-master Nov 26 07:28:32.454: INFO: Logging node info for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:28:32.497: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 10943 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:28:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:28:32.498: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:28:32.560: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8 Nov 26 07:28:32.707: INFO: kube-proxy-bootstrap-e2e-minion-group-dwd8 started at 2022-11-26 07:09:52 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 07:28:32.707: INFO: metadata-proxy-v0.1-hcl5n started at 2022-11-26 07:09:53 +0000 UTC (0+2 container statuses recorded) Nov 26 07:28:32.707: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:28:32.707: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:28:32.707: INFO: test-pod-3 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container token-test ready: false, restart count 0 Nov 26 07:28:32.707: INFO: metrics-server-v0.5.2-867b8754b9-zrfqf started at 2022-11-26 07:10:22 +0000 UTC (0+2 container statuses recorded) Nov 26 07:28:32.707: INFO: Container metrics-server ready: false, restart count 6 Nov 26 07:28:32.707: INFO: Container metrics-server-nanny ready: false, restart count 7 Nov 26 07:28:32.707: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-gcbfg started at 2022-11-26 07:11:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container sample-crd-conversion-webhook ready: false, restart count 6 Nov 26 07:28:32.707: INFO: implicit-nonroot-uid started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container implicit-nonroot-uid ready: false, restart count 0 Nov 26 07:28:32.707: INFO: pfpod started at 2022-11-26 07:19:18 +0000 UTC (0+2 container statuses recorded) Nov 26 07:28:32.707: INFO: Container portforwardtester ready: false, restart count 0 Nov 26 07:28:32.707: INFO: Container readiness ready: false, restart count 0 Nov 26 07:28:32.707: INFO: up-down-1-ffjgt started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container up-down-1 ready: true, restart count 4 Nov 26 07:28:32.707: INFO: concurrent-27824123-hdhlc started at 2022-11-26 07:23:22 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container c ready: true, restart count 3 Nov 26 07:28:32.707: INFO: e2e-zp4g8-hrbcn started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container c ready: false, restart count 0 Nov 26 07:28:32.707: INFO: inline-volume-tester-7vfrm started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 07:28:32.707: INFO: up-down-2-2pzwj started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container up-down-2 ready: false, restart count 4 Nov 26 07:28:32.707: INFO: verify-service-up-exec-pod-mf9vw started at 2022-11-26 07:23:51 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 07:28:32.707: INFO: test-webserver-039afd23-9dac-425b-8ec3-492edeedba63 started at 2022-11-26 07:23:53 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container test-webserver ready: true, restart count 3 Nov 26 07:28:32.707: INFO: external-provisioner-6zv6g started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container nfs-provisioner ready: false, restart count 6 Nov 26 07:28:32.707: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:54 +0000 UTC (0+7 container statuses recorded) Nov 26 07:28:32.707: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 07:28:32.707: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:28:32.707: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 07:28:32.707: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 07:28:32.707: INFO: Container hostpath ready: false, restart count 5 Nov 26 07:28:32.707: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 07:28:32.707: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 07:28:32.707: INFO: konnectivity-agent-qfhtq started at 2022-11-26 07:10:07 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container konnectivity-agent ready: true, restart count 7 Nov 26 07:28:32.707: INFO: busybox-baf67443-54ea-47c6-98aa-71ed72364ec4 started at 2022-11-26 07:23:57 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container busybox ready: true, restart count 1 Nov 26 07:28:32.707: INFO: e2e-zp4g8-48r9k started at 2022-11-26 07:11:57 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container c ready: false, restart count 0 Nov 26 07:28:32.707: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:35 +0000 UTC (0+7 container statuses recorded) Nov 26 07:28:32.707: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 07:28:32.707: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 07:28:32.707: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 07:28:32.707: INFO: Container csi-snapshotter ready: true, restart count 5 Nov 26 07:28:32.707: INFO: Container hostpath ready: true, restart count 5 Nov 26 07:28:32.707: INFO: Container liveness-probe ready: true, restart count 5 Nov 26 07:28:32.707: INFO: Container node-driver-registrar ready: true, restart count 5 Nov 26 07:28:32.707: INFO: affinity-nodeport-pxjt4 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container affinity-nodeport ready: true, restart count 4 Nov 26 07:28:32.707: INFO: oidc-discovery-validator started at 2022-11-26 07:23:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container oidc-discovery-validator ready: false, restart count 0 Nov 26 07:28:32.707: INFO: concurrent-27824124-tz2n7 started at 2022-11-26 07:24:00 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container c ready: true, restart count 2 Nov 26 07:28:32.707: INFO: execpod-affinityj9z2l started at 2022-11-26 07:12:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 07:28:32.707: INFO: pod-update-activedeadlineseconds-5955fd5a-b020-4868-bf7d-f791bacdcebd started at 2022-11-26 07:19:19 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:32.707: INFO: Container pause ready: false, restart count 1 Nov 26 07:28:33.031: INFO: Latency metrics for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:28:33.031: INFO: Logging node info for node bootstrap-e2e-minion-group-fx4h Nov 26 07:28:33.083: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 10948 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8980":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9869":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:28:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:28:33.084: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-fx4h Nov 26 07:28:33.129: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h Nov 26 07:28:33.199: INFO: pod-configmaps-d8c89993-128a-416a-b57f-998af5485f65 started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 07:28:33.199: INFO: metadata-proxy-v0.1-tm7ft started at 2022-11-26 07:09:43 +0000 UTC (0+2 container statuses recorded) Nov 26 07:28:33.199: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:28:33.199: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:28:33.199: INFO: konnectivity-agent-sznlb started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container konnectivity-agent ready: true, restart count 6 Nov 26 07:28:33.199: INFO: pod-0525a741-dd01-4230-ab87-046a3722256a started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container write-pod ready: true, restart count 0 Nov 26 07:28:33.199: INFO: affinity-nodeport-xkl85 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container affinity-nodeport ready: false, restart count 5 Nov 26 07:28:33.199: INFO: kube-proxy-bootstrap-e2e-minion-group-fx4h started at 2022-11-26 07:09:42 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 07:28:33.199: INFO: csi-mockplugin-0 started at 2022-11-26 07:19:20 +0000 UTC (0+3 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 07:28:33.199: INFO: Container driver-registrar ready: true, restart count 2 Nov 26 07:28:33.199: INFO: Container mock ready: true, restart count 2 Nov 26 07:28:33.199: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-t94rt started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost-container ready: true, restart count 6 Nov 26 07:28:33.199: INFO: e2e-host-exec started at 2022-11-26 07:23:35 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container e2e-host-exec ready: true, restart count 1 Nov 26 07:28:33.199: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-k4crh started at 2022-11-26 07:11:49 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost-container ready: false, restart count 4 Nov 26 07:28:33.199: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:19:20 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 07:28:33.199: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-vk4nw started at 2022-11-26 07:24:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost-container ready: false, restart count 2 Nov 26 07:28:33.199: INFO: test-pod-1 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container token-test ready: false, restart count 0 Nov 26 07:28:33.199: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:17:10 +0000 UTC (0+7 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 07:28:33.199: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:28:33.199: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 07:28:33.199: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 07:28:33.199: INFO: Container hostpath ready: false, restart count 5 Nov 26 07:28:33.199: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 07:28:33.199: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 07:28:33.199: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:12 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 07:28:33.199: INFO: pod3 started at 2022-11-26 07:23:32 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost ready: true, restart count 1 Nov 26 07:28:33.199: INFO: up-down-2-w26j5 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container up-down-2 ready: true, restart count 4 Nov 26 07:28:33.199: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:19:23 +0000 UTC (0+7 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 07:28:33.199: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 07:28:33.199: INFO: Container csi-resizer ready: true, restart count 5 Nov 26 07:28:33.199: INFO: Container csi-snapshotter ready: true, restart count 5 Nov 26 07:28:33.199: INFO: Container hostpath ready: true, restart count 5 Nov 26 07:28:33.199: INFO: Container liveness-probe ready: true, restart count 5 Nov 26 07:28:33.199: INFO: Container node-driver-registrar ready: true, restart count 5 Nov 26 07:28:33.199: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-hrfdg started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost-container ready: false, restart count 4 Nov 26 07:28:33.199: INFO: pod1 started at 2022-11-26 07:23:26 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost ready: true, restart count 1 Nov 26 07:28:33.199: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:03 +0000 UTC (0+3 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 07:28:33.199: INFO: Container driver-registrar ready: false, restart count 6 Nov 26 07:28:33.199: INFO: Container mock ready: false, restart count 6 Nov 26 07:28:33.199: INFO: kube-dns-autoscaler-5f6455f985-mr42t started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container autoscaler ready: true, restart count 7 Nov 26 07:28:33.199: INFO: l7-default-backend-8549d69d99-wf7s6 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container default-http-backend ready: true, restart count 0 Nov 26 07:28:33.199: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:12 +0000 UTC (0+3 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-provisioner ready: false, restart count 3 Nov 26 07:28:33.199: INFO: Container driver-registrar ready: false, restart count 3 Nov 26 07:28:33.199: INFO: Container mock ready: false, restart count 3 Nov 26 07:28:33.199: INFO: coredns-6d97d5ddb-r7jr7 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container coredns ready: false, restart count 7 Nov 26 07:28:33.199: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+4 container statuses recorded) Nov 26 07:28:33.199: INFO: Container busybox ready: true, restart count 6 Nov 26 07:28:33.199: INFO: Container csi-provisioner ready: false, restart count 6 Nov 26 07:28:33.199: INFO: Container driver-registrar ready: false, restart count 7 Nov 26 07:28:33.199: INFO: Container mock ready: false, restart count 7 Nov 26 07:28:33.199: INFO: pod2 started at 2022-11-26 07:23:30 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container agnhost ready: false, restart count 4 Nov 26 07:28:33.199: INFO: pod-subpath-test-preprovisionedpv-snzn started at 2022-11-26 07:12:03 +0000 UTC (2+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Init container init-volume-preprovisionedpv-snzn ready: true, restart count 0 Nov 26 07:28:33.199: INFO: Init container test-init-volume-preprovisionedpv-snzn ready: true, restart count 0 Nov 26 07:28:33.199: INFO: Container test-container-subpath-preprovisionedpv-snzn ready: false, restart count 0 Nov 26 07:28:33.199: INFO: pod-subpath-test-preprovisionedpv-tzwd started at 2022-11-26 07:12:04 +0000 UTC (2+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Init container init-volume-preprovisionedpv-tzwd ready: true, restart count 0 Nov 26 07:28:33.199: INFO: Init container test-init-volume-preprovisionedpv-tzwd ready: true, restart count 0 Nov 26 07:28:33.199: INFO: Container test-container-subpath-preprovisionedpv-tzwd ready: false, restart count 0 Nov 26 07:28:33.199: INFO: volume-snapshot-controller-0 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container volume-snapshot-controller ready: true, restart count 6 Nov 26 07:28:33.199: INFO: up-down-1-ghvx6 started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container up-down-1 ready: true, restart count 0 Nov 26 07:28:33.199: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.199: INFO: Container csi-attacher ready: false, restart count 4 Nov 26 07:28:33.458: INFO: Latency metrics for node bootstrap-e2e-minion-group-fx4h Nov 26 07:28:33.458: INFO: Logging node info for node bootstrap-e2e-minion-group-s2jb Nov 26 07:28:33.501: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 10720 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7726":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:27:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:28:33.502: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-s2jb Nov 26 07:28:33.549: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb Nov 26 07:28:33.647: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+3 container statuses recorded) Nov 26 07:28:33.647: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:28:33.647: INFO: Container driver-registrar ready: false, restart count 6 Nov 26 07:28:33.647: INFO: Container mock ready: false, restart count 5 Nov 26 07:28:33.647: INFO: verify-service-up-host-exec-pod started at 2022-11-26 07:23:43 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 07:28:33.647: INFO: client-containers-176852e0-aa4f-4787-8c18-2f872553a326 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 07:28:33.647: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-bnhs4 started at 2022-11-26 07:19:40 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 07:28:33.647: INFO: apparmor-loader-95hjv started at 2022-11-26 07:23:39 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container apparmor-loader ready: true, restart count 0 Nov 26 07:28:33.647: INFO: kube-proxy-bootstrap-e2e-minion-group-s2jb started at 2022-11-26 07:09:43 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container kube-proxy ready: false, restart count 7 Nov 26 07:28:33.647: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-lsrjh started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container agnhost-container ready: true, restart count 3 Nov 26 07:28:33.647: INFO: e2e-zp4g8-89zc8 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container c ready: false, restart count 0 Nov 26 07:28:33.647: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:11:52 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 07:28:33.647: INFO: pod-1 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container donothing ready: true, restart count 4 Nov 26 07:28:33.647: INFO: konnectivity-agent-5cmvk started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container konnectivity-agent ready: false, restart count 6 Nov 26 07:28:33.647: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-7xqc7 started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container agnhost-container ready: false, restart count 6 Nov 26 07:28:33.647: INFO: coredns-6d97d5ddb-qnmdd started at 2022-11-26 07:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container coredns ready: false, restart count 7 Nov 26 07:28:33.647: INFO: test-pod-2 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container token-test ready: false, restart count 0 Nov 26 07:28:33.647: INFO: pod-0 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container donothing ready: true, restart count 5 Nov 26 07:28:33.647: INFO: pod-subpath-test-preprovisionedpv-xn2t started at 2022-11-26 07:12:04 +0000 UTC (1+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Init container init-volume-preprovisionedpv-xn2t ready: true, restart count 0 Nov 26 07:28:33.647: INFO: Container test-container-subpath-preprovisionedpv-xn2t ready: false, restart count 0 Nov 26 07:28:33.647: INFO: httpd started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container httpd ready: true, restart count 7 Nov 26 07:28:33.647: INFO: pod-2 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container donothing ready: true, restart count 4 Nov 26 07:28:33.647: INFO: up-down-2-9qgl7 started at 2022-11-26 07:23:36 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container up-down-2 ready: true, restart count 3 Nov 26 07:28:33.647: INFO: test-apparmor-88fsj started at 2022-11-26 07:23:50 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container test ready: false, restart count 0 Nov 26 07:28:33.647: INFO: pod-secrets-2fe85272-67c8-4ec5-8f6a-1601198e215a started at 2022-11-26 07:11:56 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container secret-volume-test ready: false, restart count 0 Nov 26 07:28:33.647: INFO: e2e-zp4g8-rlbsv started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container c ready: false, restart count 0 Nov 26 07:28:33.647: INFO: up-down-1-7kskn started at 2022-11-26 07:23:23 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container up-down-1 ready: true, restart count 0 Nov 26 07:28:33.647: INFO: csi-mockplugin-0 started at 2022-11-26 07:23:47 +0000 UTC (0+3 container statuses recorded) Nov 26 07:28:33.647: INFO: Container csi-provisioner ready: true, restart count 5 Nov 26 07:28:33.647: INFO: Container driver-registrar ready: true, restart count 5 Nov 26 07:28:33.647: INFO: Container mock ready: true, restart count 5 Nov 26 07:28:33.647: INFO: metadata-proxy-v0.1-ztb2m started at 2022-11-26 07:09:44 +0000 UTC (0+2 container statuses recorded) Nov 26 07:28:33.647: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:28:33.647: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:28:33.647: INFO: affinity-nodeport-w6shs started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container affinity-nodeport ready: true, restart count 3 Nov 26 07:28:33.647: INFO: external-provisioner-hh2kt started at 2022-11-26 07:11:50 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container nfs-provisioner ready: true, restart count 5 Nov 26 07:28:33.647: INFO: pod-8975089f-4c51-4935-824c-48dec8be150b started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:28:33.647: INFO: Container write-pod ready: false, restart count 0 Nov 26 07:28:33.859: INFO: Latency metrics for node bootstrap-e2e-minion-group-s2jb [DeferCleanup (Each)] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] tear down framework | framework.go:193 STEP: Destroying namespace "custom-resource-definition-6826" for this suite. 11/26/22 07:28:33.859
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sDiscovery\sCustom\sresource\sshould\shave\sstorage\sversion\shash$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009bad20) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] Discovery set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:50:06.241 Nov 26 07:50:06.241: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename discovery 11/26/22 07:50:06.242 Nov 26 07:50:06.281: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:08.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:10.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:12.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:14.322: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:16.322: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:18.322: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:20.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:22.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:24.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:26.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:28.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:30.322: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:32.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:34.321: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.322: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.361: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.361: INFO: Unexpected error: <*errors.errorString | 0xc00011dd80>: { s: "timed out waiting for the condition", } Nov 26 07:50:36.361: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0009bad20) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] Discovery test/e2e/framework/node/init/init.go:32 Nov 26 07:50:36.362: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] Discovery dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:50:36.401 [DeferCleanup (Each)] [sig-api-machinery] Discovery tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sDiscovery\sshould\saccurately\sdetermine\spresent\sand\smissing\sresources$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0000eed20) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] Discovery set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:20:03.86 Nov 26 07:20:03.860: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename discovery 11/26/22 07:20:03.862 Nov 26 07:22:03.911: INFO: Unexpected error: <*fmt.wrapError | 0xc004afe000>: { msg: "wait for service account \"default\" in namespace \"discovery-3107\": timed out waiting for the condition", err: <*errors.errorString | 0xc00011bd80>{ s: "timed out waiting for the condition", }, } Nov 26 07:22:03.911: FAIL: wait for service account "default" in namespace "discovery-3107": timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0000eed20) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] Discovery test/e2e/framework/node/init/init.go:32 Nov 26 07:22:03.912: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] Discovery dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:22:03.955 STEP: Collecting events from namespace "discovery-3107". 11/26/22 07:22:03.955 STEP: Found 0 events. 11/26/22 07:22:03.998 Nov 26 07:22:04.040: INFO: POD NODE PHASE GRACE CONDITIONS Nov 26 07:22:04.040: INFO: Nov 26 07:22:04.084: INFO: Logging node info for node bootstrap-e2e-master Nov 26 07:22:04.127: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 8745 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:20:50 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:20:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:20:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:20:50 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:20:50 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:22:04.127: INFO: Logging kubelet events for node bootstrap-e2e-master Nov 26 07:22:04.185: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Nov 26 07:22:04.277: INFO: etcd-server-events-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container etcd-container ready: true, restart count 2 Nov 26 07:22:04.278: INFO: kube-controller-manager-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container kube-controller-manager ready: false, restart count 5 Nov 26 07:22:04.278: INFO: l7-lb-controller-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container l7-lb-controller ready: false, restart count 4 Nov 26 07:22:04.278: INFO: metadata-proxy-v0.1-c2shf started at 2022-11-26 07:10:15 +0000 UTC (0+2 container statuses recorded) Nov 26 07:22:04.278: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:22:04.278: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:22:04.278: INFO: etcd-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container etcd-container ready: true, restart count 0 Nov 26 07:22:04.278: INFO: konnectivity-server-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container konnectivity-server-container ready: true, restart count 2 Nov 26 07:22:04.278: INFO: kube-apiserver-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container kube-apiserver ready: true, restart count 1 Nov 26 07:22:04.278: INFO: kube-scheduler-bootstrap-e2e-master started at 2022-11-26 07:08:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container kube-scheduler ready: true, restart count 2 Nov 26 07:22:04.278: INFO: kube-addon-manager-bootstrap-e2e-master started at 2022-11-26 07:09:18 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.278: INFO: Container kube-addon-manager ready: true, restart count 0 Nov 26 07:22:04.505: INFO: Latency metrics for node bootstrap-e2e-master Nov 26 07:22:04.505: INFO: Logging node info for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:22:04.569: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 8941 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-106":"bootstrap-e2e-minion-group-dwd8","csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {node-problem-detector Update v1 2022-11-26 07:19:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:21:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:19:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:17:23 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-9655^46036c60-6d5a-11ed-a3cd-726c96e55273],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-9655^46036c60-6d5a-11ed-a3cd-726c96e55273,DevicePath:,},},Config:nil,},} Nov 26 07:22:04.569: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:22:04.621: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8 Nov 26 07:22:04.705: INFO: concurrent-27824120-jkn4h started at 2022-11-26 07:20:00 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container c ready: true, restart count 1 Nov 26 07:22:04.705: INFO: metrics-server-v0.5.2-867b8754b9-zrfqf started at 2022-11-26 07:10:22 +0000 UTC (0+2 container statuses recorded) Nov 26 07:22:04.705: INFO: Container metrics-server ready: false, restart count 5 Nov 26 07:22:04.705: INFO: Container metrics-server-nanny ready: false, restart count 6 Nov 26 07:22:04.705: INFO: pod-adoption-release-mnhs4 started at 2022-11-26 07:19:35 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container pod-adoption-release ready: false, restart count 0 Nov 26 07:22:04.705: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-gcbfg started at 2022-11-26 07:11:59 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container sample-crd-conversion-webhook ready: false, restart count 5 Nov 26 07:22:04.705: INFO: implicit-nonroot-uid started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container implicit-nonroot-uid ready: false, restart count 0 Nov 26 07:22:04.705: INFO: pfpod started at 2022-11-26 07:19:18 +0000 UTC (0+2 container statuses recorded) Nov 26 07:22:04.705: INFO: Container portforwardtester ready: false, restart count 0 Nov 26 07:22:04.705: INFO: Container readiness ready: false, restart count 0 Nov 26 07:22:04.705: INFO: dns-test-0ba045f1-c7d2-45f8-8fe7-f9cc1f5f517c started at 2022-11-26 07:16:49 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:04.705: INFO: Container jessie-querier ready: false, restart count 4 Nov 26 07:22:04.705: INFO: Container querier ready: false, restart count 4 Nov 26 07:22:04.705: INFO: Container webserver ready: false, restart count 4 Nov 26 07:22:04.705: INFO: concurrent-27824119-qmgc8 started at 2022-11-26 07:19:17 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container c ready: true, restart count 0 Nov 26 07:22:04.705: INFO: pod-adoption-release started at 2022-11-26 07:19:33 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container pod-adoption-release ready: true, restart count 0 Nov 26 07:22:04.705: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:25 +0000 UTC (0+7 container statuses recorded) Nov 26 07:22:04.705: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 07:22:04.705: INFO: Container csi-provisioner ready: true, restart count 1 Nov 26 07:22:04.705: INFO: Container csi-resizer ready: true, restart count 1 Nov 26 07:22:04.705: INFO: Container csi-snapshotter ready: true, restart count 1 Nov 26 07:22:04.705: INFO: Container hostpath ready: true, restart count 1 Nov 26 07:22:04.705: INFO: Container liveness-probe ready: true, restart count 1 Nov 26 07:22:04.705: INFO: Container node-driver-registrar ready: true, restart count 1 Nov 26 07:22:04.705: INFO: e2e-zp4g8-hrbcn started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container c ready: false, restart count 0 Nov 26 07:22:04.705: INFO: inline-volume-tester-7vfrm started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 07:22:04.705: INFO: external-provisioner-6zv6g started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container nfs-provisioner ready: true, restart count 5 Nov 26 07:22:04.705: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:11:54 +0000 UTC (0+7 container statuses recorded) Nov 26 07:22:04.705: INFO: Container csi-attacher ready: false, restart count 2 Nov 26 07:22:04.705: INFO: Container csi-provisioner ready: false, restart count 2 Nov 26 07:22:04.705: INFO: Container csi-resizer ready: false, restart count 2 Nov 26 07:22:04.705: INFO: Container csi-snapshotter ready: false, restart count 2 Nov 26 07:22:04.705: INFO: Container hostpath ready: false, restart count 2 Nov 26 07:22:04.705: INFO: Container liveness-probe ready: false, restart count 2 Nov 26 07:22:04.705: INFO: Container node-driver-registrar ready: false, restart count 3 Nov 26 07:22:04.705: INFO: konnectivity-agent-qfhtq started at 2022-11-26 07:10:07 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container konnectivity-agent ready: false, restart count 5 Nov 26 07:22:04.705: INFO: e2e-zp4g8-48r9k started at 2022-11-26 07:11:57 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container c ready: false, restart count 0 Nov 26 07:22:04.705: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:35 +0000 UTC (0+7 container statuses recorded) Nov 26 07:22:04.705: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 07:22:04.705: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 07:22:04.705: INFO: Container csi-resizer ready: true, restart count 4 Nov 26 07:22:04.705: INFO: Container csi-snapshotter ready: true, restart count 4 Nov 26 07:22:04.705: INFO: Container hostpath ready: true, restart count 4 Nov 26 07:22:04.705: INFO: Container liveness-probe ready: true, restart count 4 Nov 26 07:22:04.705: INFO: Container node-driver-registrar ready: true, restart count 4 Nov 26 07:22:04.705: INFO: affinity-nodeport-pxjt4 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container affinity-nodeport ready: true, restart count 4 Nov 26 07:22:04.705: INFO: execpod-affinityj9z2l started at 2022-11-26 07:12:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 07:22:04.705: INFO: pod-update-activedeadlineseconds-5955fd5a-b020-4868-bf7d-f791bacdcebd started at 2022-11-26 07:19:19 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container pause ready: false, restart count 1 Nov 26 07:22:04.705: INFO: pod-a6afd542-45da-48fe-a5d6-c1da3e4713cc started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container write-pod ready: false, restart count 0 Nov 26 07:22:04.705: INFO: kube-proxy-bootstrap-e2e-minion-group-dwd8 started at 2022-11-26 07:09:52 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container kube-proxy ready: false, restart count 6 Nov 26 07:22:04.705: INFO: metadata-proxy-v0.1-hcl5n started at 2022-11-26 07:09:53 +0000 UTC (0+2 container statuses recorded) Nov 26 07:22:04.705: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:22:04.705: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:22:04.705: INFO: test-pod-3 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:04.705: INFO: Container token-test ready: false, restart count 0 Nov 26 07:22:04.937: INFO: Latency metrics for node bootstrap-e2e-minion-group-dwd8 Nov 26 07:22:04.937: INFO: Logging node info for node bootstrap-e2e-minion-group-fx4h Nov 26 07:22:04.980: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 8929 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8980":"bootstrap-e2e-minion-group-fx4h","csi-hostpath-provisioning-4034":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4790":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9094":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9869":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {node-problem-detector Update v1 2022-11-26 07:19:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:volumesAttached":{}}} status} {kubelet Update v1 2022-11-26 07:21:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:19:48 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:20:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:20:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:20:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:20:47 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8980^aa56e6de-6d5a-11ed-b154-7a7e378df9a8,DevicePath:,},},Config:nil,},} Nov 26 07:22:04.981: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-fx4h Nov 26 07:22:05.030: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h Nov 26 07:22:05.094: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:19:23 +0000 UTC (0+7 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 07:22:05.094: INFO: Container csi-provisioner ready: true, restart count 1 Nov 26 07:22:05.094: INFO: Container csi-resizer ready: true, restart count 1 Nov 26 07:22:05.094: INFO: Container csi-snapshotter ready: true, restart count 1 Nov 26 07:22:05.094: INFO: Container hostpath ready: true, restart count 1 Nov 26 07:22:05.094: INFO: Container liveness-probe ready: true, restart count 1 Nov 26 07:22:05.094: INFO: Container node-driver-registrar ready: true, restart count 1 Nov 26 07:22:05.094: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-hrfdg started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 07:22:05.094: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:03 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-provisioner ready: false, restart count 4 Nov 26 07:22:05.094: INFO: Container driver-registrar ready: false, restart count 4 Nov 26 07:22:05.094: INFO: Container mock ready: false, restart count 4 Nov 26 07:22:05.094: INFO: kube-dns-autoscaler-5f6455f985-mr42t started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container autoscaler ready: false, restart count 5 Nov 26 07:22:05.094: INFO: l7-default-backend-8549d69d99-wf7s6 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container default-http-backend ready: true, restart count 0 Nov 26 07:22:05.094: INFO: csi-mockplugin-0 started at 2022-11-26 07:15:43 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 07:22:05.094: INFO: Container driver-registrar ready: true, restart count 4 Nov 26 07:22:05.094: INFO: Container mock ready: true, restart count 4 Nov 26 07:22:05.094: INFO: csi-mockplugin-0 started at 2022-11-26 07:16:12 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container driver-registrar ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container mock ready: true, restart count 2 Nov 26 07:22:05.094: INFO: pod-subpath-test-preprovisionedpv-tzwd started at 2022-11-26 07:12:04 +0000 UTC (2+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Init container init-volume-preprovisionedpv-tzwd ready: true, restart count 0 Nov 26 07:22:05.094: INFO: Init container test-init-volume-preprovisionedpv-tzwd ready: true, restart count 0 Nov 26 07:22:05.094: INFO: Container test-container-subpath-preprovisionedpv-tzwd ready: false, restart count 0 Nov 26 07:22:05.094: INFO: coredns-6d97d5ddb-r7jr7 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container coredns ready: false, restart count 6 Nov 26 07:22:05.094: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+4 container statuses recorded) Nov 26 07:22:05.094: INFO: Container busybox ready: true, restart count 5 Nov 26 07:22:05.094: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:22:05.094: INFO: Container driver-registrar ready: true, restart count 6 Nov 26 07:22:05.094: INFO: Container mock ready: true, restart count 6 Nov 26 07:22:05.094: INFO: pod-subpath-test-preprovisionedpv-snzn started at 2022-11-26 07:12:03 +0000 UTC (2+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Init container init-volume-preprovisionedpv-snzn ready: true, restart count 0 Nov 26 07:22:05.094: INFO: Init container test-init-volume-preprovisionedpv-snzn ready: true, restart count 0 Nov 26 07:22:05.094: INFO: Container test-container-subpath-preprovisionedpv-snzn ready: false, restart count 0 Nov 26 07:22:05.094: INFO: volume-snapshot-controller-0 started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container volume-snapshot-controller ready: true, restart count 5 Nov 26 07:22:05.094: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 07:22:05.094: INFO: pod-configmaps-d8c89993-128a-416a-b57f-998af5485f65 started at 2022-11-26 07:16:44 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 07:22:05.094: INFO: metadata-proxy-v0.1-tm7ft started at 2022-11-26 07:09:43 +0000 UTC (0+2 container statuses recorded) Nov 26 07:22:05.094: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:22:05.094: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:22:05.094: INFO: konnectivity-agent-sznlb started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container konnectivity-agent ready: true, restart count 5 Nov 26 07:22:05.094: INFO: pod-0525a741-dd01-4230-ab87-046a3722256a started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container write-pod ready: true, restart count 0 Nov 26 07:22:05.094: INFO: affinity-nodeport-xkl85 started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container affinity-nodeport ready: false, restart count 3 Nov 26 07:22:05.094: INFO: kube-proxy-bootstrap-e2e-minion-group-fx4h started at 2022-11-26 07:09:42 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container kube-proxy ready: false, restart count 6 Nov 26 07:22:05.094: INFO: csi-mockplugin-0 started at 2022-11-26 07:19:20 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container driver-registrar ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container mock ready: true, restart count 2 Nov 26 07:22:05.094: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-t94rt started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container agnhost-container ready: false, restart count 4 Nov 26 07:22:05.094: INFO: inline-volume-tester-bj4jv started at 2022-11-26 07:19:29 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-volume-tester ready: false, restart count 0 Nov 26 07:22:05.094: INFO: hostexec-bootstrap-e2e-minion-group-fx4h-k4crh started at 2022-11-26 07:11:49 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container agnhost-container ready: false, restart count 1 Nov 26 07:22:05.094: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:19:20 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-attacher ready: true, restart count 1 Nov 26 07:22:05.094: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:15:43 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-attacher ready: true, restart count 4 Nov 26 07:22:05.094: INFO: test-pod-1 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container token-test ready: false, restart count 0 Nov 26 07:22:05.094: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:17:10 +0000 UTC (0+7 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container csi-provisioner ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container csi-resizer ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container csi-snapshotter ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container hostpath ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container liveness-probe ready: true, restart count 2 Nov 26 07:22:05.094: INFO: Container node-driver-registrar ready: true, restart count 2 Nov 26 07:22:05.094: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:16:12 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.094: INFO: Container csi-attacher ready: true, restart count 2 Nov 26 07:22:05.401: INFO: Latency metrics for node bootstrap-e2e-minion-group-fx4h Nov 26 07:22:05.401: INFO: Logging node info for node bootstrap-e2e-minion-group-s2jb Nov 26 07:22:05.450: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 8523 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volumemode-99":"bootstrap-e2e-minion-group-s2jb","csi-mock-csi-mock-volumes-4538":"bootstrap-e2e-minion-group-s2jb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:19:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:19:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:19:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:19:25 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Nov 26 07:22:05.450: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-s2jb Nov 26 07:22:05.502: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb Nov 26 07:22:05.720: INFO: affinity-nodeport-w6shs started at 2022-11-26 07:11:46 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container affinity-nodeport ready: true, restart count 2 Nov 26 07:22:05.720: INFO: external-provisioner-hh2kt started at 2022-11-26 07:11:50 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container nfs-provisioner ready: true, restart count 3 Nov 26 07:22:05.720: INFO: pod-8975089f-4c51-4935-824c-48dec8be150b started at 2022-11-26 07:12:03 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container write-pod ready: false, restart count 0 Nov 26 07:22:05.720: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:16:14 +0000 UTC (0+7 container statuses recorded) Nov 26 07:22:05.720: INFO: Container csi-attacher ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container csi-provisioner ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container csi-resizer ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container csi-snapshotter ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container hostpath ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container liveness-probe ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container node-driver-registrar ready: true, restart count 0 Nov 26 07:22:05.720: INFO: csi-mockplugin-0 started at 2022-11-26 07:11:52 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:05.720: INFO: Container csi-provisioner ready: true, restart count 4 Nov 26 07:22:05.720: INFO: Container driver-registrar ready: true, restart count 4 Nov 26 07:22:05.720: INFO: Container mock ready: true, restart count 4 Nov 26 07:22:05.720: INFO: client-containers-176852e0-aa4f-4787-8c18-2f872553a326 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container agnhost-container ready: false, restart count 0 Nov 26 07:22:05.720: INFO: dns-test-66bf7ab2-c126-4d84-b98a-048a34dc2baa started at 2022-11-26 07:15:58 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:05.720: INFO: Container jessie-querier ready: false, restart count 1 Nov 26 07:22:05.720: INFO: Container querier ready: false, restart count 1 Nov 26 07:22:05.720: INFO: Container webserver ready: false, restart count 1 Nov 26 07:22:05.720: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-bnhs4 started at 2022-11-26 07:19:40 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container agnhost-container ready: true, restart count 0 Nov 26 07:22:05.720: INFO: kube-proxy-bootstrap-e2e-minion-group-s2jb started at 2022-11-26 07:09:43 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container kube-proxy ready: false, restart count 6 Nov 26 07:22:05.720: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-lsrjh started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container agnhost-container ready: false, restart count 2 Nov 26 07:22:05.720: INFO: e2e-zp4g8-89zc8 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container c ready: false, restart count 0 Nov 26 07:22:05.720: INFO: csi-mockplugin-attacher-0 started at 2022-11-26 07:11:52 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container csi-attacher ready: true, restart count 5 Nov 26 07:22:05.720: INFO: pod-1 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container donothing ready: true, restart count 3 Nov 26 07:22:05.720: INFO: konnectivity-agent-5cmvk started at 2022-11-26 07:09:58 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container konnectivity-agent ready: false, restart count 5 Nov 26 07:22:05.720: INFO: dns-test-9f206a1d-f53c-4783-9c4d-78871004081e started at 2022-11-26 07:16:06 +0000 UTC (0+3 container statuses recorded) Nov 26 07:22:05.720: INFO: Container jessie-querier ready: true, restart count 3 Nov 26 07:22:05.720: INFO: Container querier ready: true, restart count 3 Nov 26 07:22:05.720: INFO: Container webserver ready: true, restart count 3 Nov 26 07:22:05.720: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-7xqc7 started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container agnhost-container ready: true, restart count 4 Nov 26 07:22:05.720: INFO: csi-hostpathplugin-0 started at 2022-11-26 07:14:00 +0000 UTC (0+7 container statuses recorded) Nov 26 07:22:05.720: INFO: Container csi-attacher ready: false, restart count 5 Nov 26 07:22:05.720: INFO: Container csi-provisioner ready: false, restart count 5 Nov 26 07:22:05.720: INFO: Container csi-resizer ready: false, restart count 5 Nov 26 07:22:05.720: INFO: Container csi-snapshotter ready: false, restart count 5 Nov 26 07:22:05.720: INFO: Container hostpath ready: false, restart count 5 Nov 26 07:22:05.720: INFO: Container liveness-probe ready: false, restart count 5 Nov 26 07:22:05.720: INFO: Container node-driver-registrar ready: false, restart count 5 Nov 26 07:22:05.720: INFO: hostexec-bootstrap-e2e-minion-group-s2jb-mzlfl started at 2022-11-26 07:19:36 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container agnhost-container ready: true, restart count 2 Nov 26 07:22:05.720: INFO: coredns-6d97d5ddb-qnmdd started at 2022-11-26 07:10:04 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container coredns ready: false, restart count 6 Nov 26 07:22:05.720: INFO: test-pod-2 started at 2022-11-26 07:11:48 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container token-test ready: false, restart count 0 Nov 26 07:22:05.720: INFO: pod-0 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container donothing ready: true, restart count 4 Nov 26 07:22:05.720: INFO: pod-subpath-test-preprovisionedpv-xn2t started at 2022-11-26 07:12:04 +0000 UTC (1+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Init container init-volume-preprovisionedpv-xn2t ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container test-container-subpath-preprovisionedpv-xn2t ready: false, restart count 0 Nov 26 07:22:05.720: INFO: httpd started at 2022-11-26 07:11:47 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container httpd ready: true, restart count 4 Nov 26 07:22:05.720: INFO: pod-2 started at 2022-11-26 07:11:55 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container donothing ready: true, restart count 2 Nov 26 07:22:05.720: INFO: pod-secrets-2fe85272-67c8-4ec5-8f6a-1601198e215a started at 2022-11-26 07:11:56 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container secret-volume-test ready: false, restart count 0 Nov 26 07:22:05.720: INFO: e2e-zp4g8-rlbsv started at 2022-11-26 07:13:25 +0000 UTC (0+1 container statuses recorded) Nov 26 07:22:05.720: INFO: Container c ready: false, restart count 0 Nov 26 07:22:05.720: INFO: metadata-proxy-v0.1-ztb2m started at 2022-11-26 07:09:44 +0000 UTC (0+2 container statuses recorded) Nov 26 07:22:05.720: INFO: Container metadata-proxy ready: true, restart count 0 Nov 26 07:22:05.720: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Nov 26 07:22:06.072: INFO: Latency metrics for node bootstrap-e2e-minion-group-s2jb [DeferCleanup (Each)] [sig-api-machinery] Discovery tear down framework | framework.go:193 STEP: Destroying namespace "discovery-3107" for this suite. 11/26/22 07:22:06.072
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\skeep\sthe\src\saround\suntil\sall\sits\spods\sare\sdeleted\sif\sthe\sdeleteOptions\ssays\sso\s\[Conformance\]$'
test/e2e/apimachinery/garbage_collector.go:709
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.6()
test/e2e/apimachinery/garbage_collector.go:709 +0x611
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:12:08.141: failed to list events in namespace "gc-8602": Get "https://34.83.149.76/api/v1/namespaces/gc-8602/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:12:08.181: Couldn't delete ns: "gc-8602": Delete "https://34.83.149.76/api/v1/namespaces/gc-8602": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/gc-8602", Err:(*net.OpError)(0xc002de02d0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] Garbage collector
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:11:56.367
Nov 26 07:11:56.367: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/26/22 07:11:56.369
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:11:56.534
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:11:56.637
[BeforeEach] [sig-api-machinery] Garbage collector
test/e2e/framework/metrics/init/init.go:31
[It] should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance]
test/e2e/apimachinery/garbage_collector.go:650
STEP: create the rc 11/26/22 07:11:56.786
STEP: delete the rc 11/26/22 07:12:01.9
STEP: wait for the rc to be deleted 11/26/22 07:12:01.982
Nov 26 07:12:03.290: INFO: 80 pods remaining
Nov 26 07:12:03.290: INFO: 80 pods has nil DeletionTimestamp
Nov 26 07:12:03.290: INFO:
Nov 26 07:12:04.134: INFO: 69 pods remaining
Nov 26 07:12:04.134: INFO: 69 pods has nil DeletionTimestamp
Nov 26 07:12:04.134: INFO:
Nov 26 07:12:05.080: INFO: 58 pods remaining
Nov 26 07:12:05.080: INFO: 58 pods has nil DeletionTimestamp
Nov 26 07:12:05.080: INFO:
Nov 26 07:12:06.076: INFO: 40 pods remaining
Nov 26 07:12:06.076: INFO: 40 pods has nil DeletionTimestamp
Nov 26 07:12:06.076: INFO:
Nov 26 07:12:07.079: INFO: 29 pods remaining
Nov 26 07:12:07.079: INFO: 29 pods has nil DeletionTimestamp
Nov 26 07:12:07.079: INFO:
Nov 26 07:12:08.061: FAIL: Get "https://34.83.149.76/api/v1/namespaces/gc-8602/pods": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.6()
test/e2e/apimachinery/garbage_collector.go:709 +0x611
[AfterEach] [sig-api-machinery] Garbage collector
test/e2e/framework/node/init/init.go:32
Nov 26 07:12:08.062: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:12:08.101
STEP: Collecting events from namespace "gc-8602". 11/26/22 07:12:08.101
Nov 26 07:12:08.141: INFO: Unexpected error: failed to list events in namespace "gc-8602":
<*url.Error | 0xc0034a2b70>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/gc-8602/events",
Err: <*net.OpError | 0xc004134910>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc002de3bc0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0001245a0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:08.141: FAIL: failed to list events in namespace "gc-8602": Get "https://34.83.149.76/api/v1/namespaces/gc-8602/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc00420c5c0, {0xc0036c9a59, 0x7})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc003a7e680}, {0xc0036c9a59, 0x7})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc00420c650?, {0xc0036c9a59?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc0000eeff0)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc0011bc2b0?, 0xc0007a6fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc0037a0a48?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0011bc2b0?, 0x29449fc?}, {0xae73300?, 0xc0007a6f80?, 0x0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
tear down framework | framework.go:193
STEP: Destroying namespace "gc-8602" for this suite. 11/26/22 07:12:08.141
Nov 26 07:12:08.181: FAIL: Couldn't delete ns: "gc-8602": Delete "https://34.83.149.76/api/v1/namespaces/gc-8602": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/gc-8602", Err:(*net.OpError)(0xc002de02d0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc0000eeff0)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0011bc1e0?, 0xc0000cefb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0011bc1e0?, 0x0?}, {0xae73300?, 0x5?, 0xc0036c8fd0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGarbage\scollector\sshould\ssupport\sorphan\sdeletion\sof\scustom\sresources$'
test/e2e/apimachinery/garbage_collector.go:1141
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.10()
test/e2e/apimachinery/garbage_collector.go:1141 +0x125a
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:12:11.136: failed to list events in namespace "gc-2322": Get "https://34.83.149.76/api/v1/namespaces/gc-2322/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:12:11.176: Couldn't delete ns: "gc-2322": Delete "https://34.83.149.76/api/v1/namespaces/gc-2322": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/gc-2322", Err:(*net.OpError)(0xc0029c4050)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-api-machinery] Garbage collector
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:11:45.608
Nov 26 07:11:45.608: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename gc 11/26/22 07:11:45.61
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:11:46.087
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:11:46.236
[BeforeEach] [sig-api-machinery] Garbage collector
test/e2e/framework/metrics/init/init.go:31
[It] should support orphan deletion of custom resources
test/e2e/apimachinery/garbage_collector.go:1040
Nov 26 07:11:46.431: INFO: >>> kubeConfig: /workspace/.kube/config
Nov 26 07:11:50.139: INFO: created owner resource "ownergkrmc"
Nov 26 07:11:50.317: INFO: created dependent resource "dependent4gkc9"
STEP: wait for the owner to be deleted 11/26/22 07:11:50.805
STEP: wait for 30 seconds to see if the garbage collector mistakenly deletes the dependent crd 11/26/22 07:11:55.977
Nov 26 07:12:11.018: FAIL: failed to ensure the dependent is not deleted: Get "https://34.83.149.76/apis/mygroup.example.com/v1beta1/fooq96q5as/dependent4gkc9": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.10()
test/e2e/apimachinery/garbage_collector.go:1141 +0x125a
Nov 26 07:12:11.057: FAIL: failed to delete CustomResourceDefinition: Delete "https://34.83.149.76/apis/apiextensions.k8s.io/v1/customresourcedefinitions/fooq96q5as.mygroup.example.com": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.10.1()
test/e2e/apimachinery/garbage_collector.go:1057 +0xbc
panic({0x70eb7e0, 0xc000302700})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Failf({0x76dd6f6?, 0x58?}, {0xc0019a1e68?, 0x0?, 0x0?})
test/e2e/framework/log.go:49 +0x12c
k8s.io/kubernetes/test/e2e/apimachinery.glob..func13.10()
test/e2e/apimachinery/garbage_collector.go:1141 +0x125a
[AfterEach] [sig-api-machinery] Garbage collector
test/e2e/framework/node/init/init.go:32
Nov 26 07:12:11.057: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:12:11.097
STEP: Collecting events from namespace "gc-2322". 11/26/22 07:12:11.097
Nov 26 07:12:11.136: INFO: Unexpected error: failed to list events in namespace "gc-2322":
<*url.Error | 0xc001d66d20>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/gc-2322/events",
Err: <*net.OpError | 0xc00170b9a0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc000cb7590>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc00120a7c0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:11.136: FAIL: failed to list events in namespace "gc-2322": Get "https://34.83.149.76/api/v1/namespaces/gc-2322/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0010f65c0, {0xc000f663b9, 0x7})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc002b9e340}, {0xc000f663b9, 0x7})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc0010f6650?, {0xc000f663b9?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000e86ff0)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc0010ce640?, 0x13?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0010ce640?, 0x29449fc?}, {0xae73300?, 0xc000689780?, 0xc000ab56d0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-api-machinery] Garbage collector
tear down framework | framework.go:193
STEP: Destroying namespace "gc-2322" for this suite. 11/26/22 07:12:11.137
Nov 26 07:12:11.176: FAIL: Couldn't delete ns: "gc-2322": Delete "https://34.83.149.76/api/v1/namespaces/gc-2322": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/gc-2322", Err:(*net.OpError)(0xc0029c4050)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000e86ff0)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0010ce320?, 0x13?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0010ce320?, 0x0?}, {0xae73300?, 0x5?, 0xc001d43660?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sResourceQuota\sshould\sverify\sResourceQuota\swith\scross\snamespace\spod\saffinity\sscope\susing\sscope\-selectors\.$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000737950) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-api-machinery] ResourceQuota set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:25:04.334 Nov 26 07:25:04.335: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename cross-namespace-pod-affinity 11/26/22 07:25:04.337 Nov 26 07:25:04.376: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:06.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:08.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:10.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:12.415: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:14.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:16.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:18.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:20.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:22.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:24.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:26.415: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:28.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:30.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:32.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:34.416: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:34.455: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:34.455: INFO: Unexpected error: <*errors.errorString | 0xc000221c50>: { s: "timed out waiting for the condition", } Nov 26 07:25:34.455: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000737950) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] ResourceQuota test/e2e/framework/node/init/init.go:32 Nov 26 07:25:34.455: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] ResourceQuota dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:25:34.495 [DeferCleanup (Each)] [sig-api-machinery] ResourceQuota tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sServerSideApply\sshould\sremove\sa\sfield\sif\sit\sis\sowned\sbut\sremoved\sin\sthe\sapply\srequest$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000acf2c0) test/e2e/framework/framework.go:241 +0x96f There were additional failures detected after the initial failure: [PANICKED] Test Panicked In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260 runtime error: invalid memory address or nil pointer dereference Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.glob..func3.2() test/e2e/apimachinery/apply.go:60 +0x45from junit_01.xml
[BeforeEach] [sig-api-machinery] ServerSideApply set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:50:06.242 Nov 26 07:50:06.242: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename apply 11/26/22 07:50:06.244 Nov 26 07:50:06.284: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:08.323: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:10.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:12.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:14.323: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:16.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:18.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:20.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:22.323: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:24.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:26.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:28.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:30.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:32.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:34.323: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.324: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.363: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.363: INFO: Unexpected error: <*errors.errorString | 0xc00017fa20>: { s: "timed out waiting for the condition", } Nov 26 07:50:36.363: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000acf2c0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-api-machinery] ServerSideApply test/e2e/framework/node/init/init.go:32 Nov 26 07:50:36.364: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] ServerSideApply test/e2e/apimachinery/apply.go:59 [DeferCleanup (Each)] [sig-api-machinery] ServerSideApply dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:50:36.403 [DeferCleanup (Each)] [sig-api-machinery] ServerSideApply tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sCronJob\sshould\sschedule\smultiple\sjobs\sconcurrently\s\[Conformance\]$'
test/e2e/apps/cronjob.go:78
k8s.io/kubernetes/test/e2e/apps.glob..func2.1()
test/e2e/apps/cronjob.go:78 +0x2dc
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:12:08.048: failed to list events in namespace "cronjob-1843": Get "https://34.83.149.76/api/v1/namespaces/cronjob-1843/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:12:08.088: Couldn't delete ns: "cronjob-1843": Delete "https://34.83.149.76/api/v1/namespaces/cronjob-1843": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/cronjob-1843", Err:(*net.OpError)(0xc002501ae0)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] CronJob
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:11:45.627
Nov 26 07:11:45.627: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename cronjob 11/26/22 07:11:45.629
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:11:47.591
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:11:47.708
[BeforeEach] [sig-apps] CronJob
test/e2e/framework/metrics/init/init.go:31
[It] should schedule multiple jobs concurrently [Conformance]
test/e2e/apps/cronjob.go:69
STEP: Creating a cronjob 11/26/22 07:11:47.822
STEP: Ensuring more than one job is running at a time 11/26/22 07:11:47.929
Nov 26 07:12:07.969: INFO: Unexpected error: Failed to wait for active jobs in CronJob concurrent in namespace cronjob-1843:
<*url.Error | 0xc002b5f890>: {
Op: "Get",
URL: "https://34.83.149.76/apis/batch/v1/namespaces/cronjob-1843/cronjobs/concurrent",
Err: <*net.OpError | 0xc002a8b810>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00265fe30>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc002b1db80>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:07.969: FAIL: Failed to wait for active jobs in CronJob concurrent in namespace cronjob-1843: Get "https://34.83.149.76/apis/batch/v1/namespaces/cronjob-1843/cronjobs/concurrent": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.glob..func2.1()
test/e2e/apps/cronjob.go:78 +0x2dc
[AfterEach] [sig-apps] CronJob
test/e2e/framework/node/init/init.go:32
Nov 26 07:12:07.969: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] CronJob
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] CronJob
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:12:08.009
STEP: Collecting events from namespace "cronjob-1843". 11/26/22 07:12:08.009
Nov 26 07:12:08.048: INFO: Unexpected error: failed to list events in namespace "cronjob-1843":
<*url.Error | 0xc002d6c450>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/cronjob-1843/events",
Err: <*net.OpError | 0xc0025017c0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc002d6c420>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc002600e40>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:08.048: FAIL: failed to list events in namespace "cronjob-1843": Get "https://34.83.149.76/api/v1/namespaces/cronjob-1843/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0029225c0, {0xc0007d9a40, 0xc})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc0023d1a00}, {0xc0007d9a40, 0xc})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc002922650?, {0xc0007d9a40?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000c5b680)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc000e3da50?, 0xc0007cdfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc000e3da50?, 0x0?}, {0xae73300?, 0x5?, 0xc002d12570?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-apps] CronJob
tear down framework | framework.go:193
STEP: Destroying namespace "cronjob-1843" for this suite. 11/26/22 07:12:08.049
Nov 26 07:12:08.088: FAIL: Couldn't delete ns: "cronjob-1843": Delete "https://34.83.149.76/api/v1/namespaces/cronjob-1843": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/cronjob-1843", Err:(*net.OpError)(0xc002501ae0)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000c5b680)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc000e3d950?, 0xc0007cdfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc000e3d950?, 0x0?}, {0xae73300?, 0x5?, 0xc002d12a80?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sdeployment\sshould\ssupport\sproportional\sscaling\s\[Conformance\]$'
test/e2e/framework/framework.go:241
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011453b0)
test/e2e/framework/framework.go:241 +0x96f
There were additional failures detected after the initial failure:
[PANICKED]
Test Panicked
In [AfterEach] at: /usr/local/go/src/runtime/panic.go:260
runtime error: invalid memory address or nil pointer dereference
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.failureTrap({0x0, 0x0}, {0x0, 0x0})
test/e2e/apps/deployment.go:615 +0x51
k8s.io/kubernetes/test/e2e/apps.glob..func5.1()
test/e2e/apps/deployment.go:85 +0x2f
[BeforeEach] [sig-apps] Deployment
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:24:43.424
Nov 26 07:24:43.424: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename deployment 11/26/22 07:24:43.426
Nov 26 07:26:43.486: INFO: Unexpected error:
<*fmt.wrapError | 0xc0032ea000>: {
msg: "wait for service account \"default\" in namespace \"deployment-9507\": timed out waiting for the condition",
err: <*errors.errorString | 0xc000197c50>{
s: "timed out waiting for the condition",
},
}
Nov 26 07:26:43.487: FAIL: wait for service account "default" in namespace "deployment-9507": timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011453b0)
test/e2e/framework/framework.go:241 +0x96f
[AfterEach] [sig-apps] Deployment
test/e2e/apps/deployment.go:84
[AfterEach] [sig-apps] Deployment
test/e2e/framework/node/init/init.go:32
Nov 26 07:26:43.487: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] Deployment
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:26:43.572
STEP: Collecting events from namespace "deployment-9507". 11/26/22 07:26:43.572
STEP: Found 0 events. 11/26/22 07:26:43.613
Nov 26 07:26:43.660: INFO: POD NODE PHASE GRACE CONDITIONS
Nov 26 07:26:43.660: INFO:
Nov 26 07:26:43.712: INFO:
Logging node info for node bootstrap-e2e-master
Nov 26 07:26:43.755: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master f0ba92bc-1ad4-4c91-804a-615f93988363 10560 0 2022-11-26 07:09:45 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:58 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2022-11-26 07:10:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2022-11-26 07:25:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858366464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596222464 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:55 +0000 UTC,LastTransitionTime:2022-11-26 07:10:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:34.83.149.76,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:573886074485ce7d35d676886acc6412,SystemUUID:57388607-4485-ce7d-35d6-76886acc6412,BootID:6a472e99-4dde-430c-9cc5-a4cd04b3d1ca,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:135160272,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:124990265,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:57660216,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:2c111f004bec24888d8cfa2a812a38fb8341350abac67dcd0ac64e709dfe389c registry.k8s.io/kas-network-proxy/proxy-server:v0.0.33],SizeBytes:22020129,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:26:43.755: INFO:
Logging kubelet events for node bootstrap-e2e-master
Nov 26 07:26:43.811: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-master
Nov 26 07:26:43.856: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available
Nov 26 07:26:43.856: INFO:
Logging node info for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:26:43.899: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-dwd8 0f92623f-1882-418e-a91f-8003470c7167 10567 0 2022-11-26 07:09:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-dwd8 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-dwd8 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-9655":"bootstrap-e2e-minion-group-dwd8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:25:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-dwd8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:55 +0000 UTC,LastTransitionTime:2022-11-26 07:09:52 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:10:07 +0000 UTC,LastTransitionTime:2022-11-26 07:10:07 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:24:01 +0000 UTC,LastTransitionTime:2022-11-26 07:09:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:34.105.59.122,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-dwd8.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:11aef0458534013f9251c7d46e9ad181,SystemUUID:11aef045-8534-013f-9251-c7d46e9ad181,BootID:d018ea2a-32a8-432b-a1a8-d84b54cb3435,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/volume/nfs@sha256:3bda73f2428522b0e342af80a0b9679e8594c2126f2b3cca39ed787589741b9e registry.k8s.io/e2e-test-images/volume/nfs:1.3],SizeBytes:95836203,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:26:43.900: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-dwd8
Nov 26 07:26:43.945: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-dwd8
Nov 26 07:26:43.989: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-dwd8: error trying to reach service: No agent available
Nov 26 07:26:43.989: INFO:
Logging node info for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:26:44.033: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-fx4h a544b423-b20d-4926-88b2-0175cdc9ee89 10645 0 2022-11-26 07:09:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-fx4h kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-fx4h topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-4034":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-4790":"bootstrap-e2e-minion-group-fx4h","csi-mock-csi-mock-volumes-9869":"bootstrap-e2e-minion-group-fx4h"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-11-26 07:09:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}}}} } {kube-controller-manager Update v1 2022-11-26 07:19:56 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2022-11-26 07:24:49 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kubelet Update v1 2022-11-26 07:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-fx4h,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:49 +0000 UTC,LastTransitionTime:2022-11-26 07:09:46 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:25:54 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.83.29.148,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-fx4h.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fdfae5ff3179638828173b54619b13fd,SystemUUID:fdfae5ff-3179-6388-2817-3b54619b13fd,BootID:950fac13-2228-4860-a7fe-c37f032b135f,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:26:44.033: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-fx4h
Nov 26 07:26:44.079: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-fx4h
Nov 26 07:26:44.123: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-fx4h: error trying to reach service: No agent available
Nov 26 07:26:44.123: INFO:
Logging node info for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:26:44.167: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-s2jb 52934e5e-2e79-4fb5-af52-d350500fbe58 10468 0 2022-11-26 07:09:43 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-s2jb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.hostpath.csi/node:bootstrap-e2e-minion-group-s2jb topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2022-11-26 07:09:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2022-11-26 07:16:20 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2022-11-26 07:23:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {node-problem-detector Update v1 2022-11-26 07:24:46 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-boskos-gce-project-03/us-west1-b/bootstrap-e2e-minion-group-s2jb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-11-26 07:24:46 +0000 UTC,LastTransitionTime:2022-11-26 07:09:44 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-11-26 07:09:58 +0000 UTC,LastTransitionTime:2022-11-26 07:09:58 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-11-26 07:23:51 +0000 UTC,LastTransitionTime:2022-11-26 07:09:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.251.236,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-s2jb.c.k8s-boskos-gce-project-03.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a199dd2a7f3c324c9bf9bd44af1a9a22,SystemUUID:a199dd2a-7f3c-324c-9bf9-bd44af1a9a22,BootID:ddf3baca-2740-46a6-9fae-64368730deb4,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.0-149-gd06318622,KubeletVersion:v1.27.0-alpha.0.50+70617042976dc1,KubeProxyVersion:v1.27.0-alpha.0.50+70617042976dc1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/sig-storage/nfs-provisioner@sha256:e943bb77c7df05ebdc8c7888b2db289b13bf9f012d6a3a5a74f14d4d5743d439 registry.k8s.io/sig-storage/nfs-provisioner:v3.0.1],SizeBytes:90632047,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.0.50_70617042976dc1],SizeBytes:67201736,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:8e352a029d304ca7431c6507b56800636c321cb52289686a581ab70aaa8a2e2a registry.k8s.io/coredns/coredns:v1.9.3],SizeBytes:14837849,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/apparmor-loader@sha256:c2ba46d9cf4549528f80d4850630b712372715e0c556d35d5c3016144365d882 registry.k8s.io/e2e-test-images/apparmor-loader:1.4],SizeBytes:8695007,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:48f2a4ec3e10553a81b8dd1c6fa5fe4bcc9617f78e71c1ca89c6921335e2d7da registry.k8s.io/kas-network-proxy/proxy-agent:v0.0.33],SizeBytes:8512162,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Nov 26 07:26:44.167: INFO:
Logging kubelet events for node bootstrap-e2e-minion-group-s2jb
Nov 26 07:26:44.213: INFO:
Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-s2jb
Nov 26 07:26:44.258: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-s2jb: error trying to reach service: No agent available
[DeferCleanup (Each)] [sig-apps] Deployment
tear down framework | framework.go:193
STEP: Destroying namespace "deployment-9507" for this suite. 11/26/22 07:26:44.258
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDisruptionController\sListing\sPodDisruptionBudgets\sfor\sall\snamespaces\sshould\slist\sand\sdelete\sa\scollection\sof\sPodDisruptionBudgets\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011aba40) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-apps] DisruptionController set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:25:02.055 Nov 26 07:25:02.055: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename disruption 11/26/22 07:25:02.057 Nov 26 07:25:02.096: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:04.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:06.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:08.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:10.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:12.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:14.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:16.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:18.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:20.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:22.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:24.135: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:26.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:28.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:30.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:32.136: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:32.176: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:25:32.176: INFO: Unexpected error: <*errors.errorString | 0xc000215d70>: { s: "timed out waiting for the condition", } Nov 26 07:25:32.176: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011aba40) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-apps] DisruptionController test/e2e/framework/node/init/init.go:32 Nov 26 07:25:32.176: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] DisruptionController dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:25:32.215 [DeferCleanup (Each)] [sig-apps] DisruptionController tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDisruptionController\sshould\sobserve\sPodDisruptionBudget\sstatus\supdated\s\[Conformance\]$'
test/e2e/apps/disruption.go:580
k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x801de88?, 0xc002f211e0}, {0xc002e57070, 0xf}, 0x3)
test/e2e/apps/disruption.go:580 +0x167
k8s.io/kubernetes/test/e2e/apps.glob..func6.4()
test/e2e/apps/disruption.go:145 +0xdc
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:12:09.556: failed to list events in namespace "disruption-9168": Get "https://34.83.149.76/api/v1/namespaces/disruption-9168/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:12:09.596: Couldn't delete ns: "disruption-9168": Delete "https://34.83.149.76/api/v1/namespaces/disruption-9168": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/disruption-9168", Err:(*net.OpError)(0xc00317cd70)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] DisruptionController
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:11:52.465
Nov 26 07:11:52.465: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename disruption 11/26/22 07:11:52.466
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:11:52.7
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:11:52.819
[BeforeEach] [sig-apps] DisruptionController
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] DisruptionController
test/e2e/apps/disruption.go:72
[It] should observe PodDisruptionBudget status updated [Conformance]
test/e2e/apps/disruption.go:141
STEP: Waiting for the pdb to be processed 11/26/22 07:11:52.992
STEP: Waiting for all pods to be running 11/26/22 07:11:55.295
Nov 26 07:11:55.436: INFO: running pods: 0 < 3
Nov 26 07:11:57.515: INFO: running pods: 0 < 3
Nov 26 07:11:59.479: INFO: running pods: 0 < 3
Nov 26 07:12:01.486: INFO: running pods: 0 < 3
Nov 26 07:12:03.482: INFO: running pods: 0 < 3
Nov 26 07:12:05.517: INFO: running pods: 0 < 3
Nov 26 07:12:07.480: INFO: running pods: 0 < 3
Nov 26 07:12:09.477: INFO: Unexpected error: Waiting for pods in namespace "disruption-9168" to be ready:
<*url.Error | 0xc0033a46c0>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/disruption-9168/pods?labelSelector=foo%3Dbar",
Err: <*net.OpError | 0xc00317cb40>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00328d590>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc00314cc20>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:09.477: FAIL: Waiting for pods in namespace "disruption-9168" to be ready: Get "https://34.83.149.76/api/v1/namespaces/disruption-9168/pods?labelSelector=foo%3Dbar": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x801de88?, 0xc002f211e0}, {0xc002e57070, 0xf}, 0x3)
test/e2e/apps/disruption.go:580 +0x167
k8s.io/kubernetes/test/e2e/apps.glob..func6.4()
test/e2e/apps/disruption.go:145 +0xdc
[AfterEach] [sig-apps] DisruptionController
test/e2e/framework/node/init/init.go:32
Nov 26 07:12:09.477: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] DisruptionController
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] DisruptionController
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:12:09.516
STEP: Collecting events from namespace "disruption-9168". 11/26/22 07:12:09.517
Nov 26 07:12:09.556: INFO: Unexpected error: failed to list events in namespace "disruption-9168":
<*url.Error | 0xc00331a7b0>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/disruption-9168/events",
Err: <*net.OpError | 0xc002711220>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc00328dad0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc003f359e0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:09.556: FAIL: failed to list events in namespace "disruption-9168": Get "https://34.83.149.76/api/v1/namespaces/disruption-9168/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc00460e5c0, {0xc002e57070, 0xf})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc002f211e0}, {0xc002e57070, 0xf})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc00460e650?, {0xc002e57070?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000cdba40)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc001480ee0?, 0xc00454dfb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc003f5c088?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001480ee0?, 0x29449fc?}, {0xae73300?, 0xc00454df80?, 0xc003391430?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-apps] DisruptionController
tear down framework | framework.go:193
STEP: Destroying namespace "disruption-9168" for this suite. 11/26/22 07:12:09.557
Nov 26 07:12:09.596: FAIL: Couldn't delete ns: "disruption-9168": Delete "https://34.83.149.76/api/v1/namespaces/disruption-9168": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/disruption-9168", Err:(*net.OpError)(0xc00317cd70)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000cdba40)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc001480e00?, 0x0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001480e00?, 0x7fe0bc8?}, {0xae73300?, 0x10000c0026ac0f0?, 0xc00177d680?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sJob\sshould\smanage\sthe\slifecycle\sof\sa\sjob\s\[Conformance\]$'
test/e2e/apps/job.go:788
k8s.io/kubernetes/test/e2e/apps.glob..func7.17()
test/e2e/apps/job.go:788 +0x121d
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:12:08.684: failed to list events in namespace "job-8811": Get "https://34.83.149.76/api/v1/namespaces/job-8811/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:12:08.724: Couldn't delete ns: "job-8811": Delete "https://34.83.149.76/api/v1/namespaces/job-8811": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/job-8811", Err:(*net.OpError)(0xc0021e5d10)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] Job
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:11:45.629
Nov 26 07:11:45.629: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename job 11/26/22 07:11:45.631
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:11:47.09
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:11:47.304
[BeforeEach] [sig-apps] Job
test/e2e/framework/metrics/init/init.go:31
[It] should manage the lifecycle of a job [Conformance]
test/e2e/apps/job.go:703
STEP: Creating a suspended job 11/26/22 07:11:47.575
STEP: Patching the Job 11/26/22 07:11:47.685
STEP: Watching for Job to be patched 11/26/22 07:11:47.776
Nov 26 07:11:47.831: INFO: Event ADDED observed for Job e2e-zp4g8 in namespace job-8811 with labels: map[e2e-job-label:e2e-zp4g8] and annotations: map[batch.kubernetes.io/job-tracking:]
Nov 26 07:11:47.831: INFO: Event MODIFIED found for Job e2e-zp4g8 in namespace job-8811 with labels: map[e2e-job-label:e2e-zp4g8 e2e-zp4g8:patched] and annotations: map[batch.kubernetes.io/job-tracking:]
STEP: Updating the job 11/26/22 07:11:47.831
STEP: Watching for Job to be updated 11/26/22 07:11:48.404
Nov 26 07:11:48.465: INFO: Event MODIFIED found for Job e2e-zp4g8 in namespace job-8811 with labels: map[e2e-job-label:e2e-zp4g8 e2e-zp4g8:patched] and annotations: map[batch.kubernetes.io/job-tracking: updated:true]
Nov 26 07:11:48.465: INFO: Found Job annotations: map[string]string{"batch.kubernetes.io/job-tracking":"", "updated":"true"}
STEP: Listing all Jobs with LabelSelector 11/26/22 07:11:48.465
Nov 26 07:11:48.565: INFO: Job: e2e-zp4g8 as labels: map[e2e-job-label:e2e-zp4g8 e2e-zp4g8:patched]
STEP: Waiting for job to complete 11/26/22 07:11:48.565
Nov 26 07:12:08.605: INFO: Unexpected error: failed to ensure job completion in namespace: job-8811:
<*url.Error | 0xc0033eeea0>: {
Op: "Get",
URL: "https://34.83.149.76/apis/batch/v1/namespaces/job-8811/jobs/e2e-zp4g8",
Err: <*net.OpError | 0xc003eaf1d0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0033720f0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc003e9ee80>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:08.605: FAIL: failed to ensure job completion in namespace: job-8811: Get "https://34.83.149.76/apis/batch/v1/namespaces/job-8811/jobs/e2e-zp4g8": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.glob..func7.17()
test/e2e/apps/job.go:788 +0x121d
[AfterEach] [sig-apps] Job
test/e2e/framework/node/init/init.go:32
Nov 26 07:12:08.605: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] Job
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] Job
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:12:08.645
STEP: Collecting events from namespace "job-8811". 11/26/22 07:12:08.645
Nov 26 07:12:08.684: INFO: Unexpected error: failed to list events in namespace "job-8811":
<*url.Error | 0xc0033726f0>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/job-8811/events",
Err: <*net.OpError | 0xc0021e59f0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0033726c0>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0021d3860>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:12:08.684: FAIL: failed to list events in namespace "job-8811": Get "https://34.83.149.76/api/v1/namespaces/job-8811/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc002e825c0, {0xc0030f2ba0, 0x8})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc002ec61a0}, {0xc0030f2ba0, 0x8})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc002e82650?, {0xc0030f2ba0?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc000b89c20)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc000faf880?, 0xc000b71fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc003eb83c8?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc000faf880?, 0x29449fc?}, {0xae73300?, 0xc000b71f80?, 0xc003eabea0?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-apps] Job
tear down framework | framework.go:193
STEP: Destroying namespace "job-8811" for this suite. 11/26/22 07:12:08.685
Nov 26 07:12:08.724: FAIL: Couldn't delete ns: "job-8811": Delete "https://34.83.149.76/api/v1/namespaces/job-8811": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/job-8811", Err:(*net.OpError)(0xc0021e5d10)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc000b89c20)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc000faf7e0?, 0xc000b71fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc000faf7e0?, 0x0?}, {0xae73300?, 0x5?, 0xc00315f760?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicaSet\sshould\slist\sand\sdelete\sa\scollection\sof\sReplicaSets\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011450e0) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-apps] ReplicaSet set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:50:06.457 Nov 26 07:50:06.457: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename replicaset 11/26/22 07:50:06.459 Nov 26 07:50:06.498: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:08.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:10.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:12.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:14.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:16.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:18.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:20.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:22.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:24.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:26.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:28.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:30.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:32.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:34.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.538: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.577: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:36.577: INFO: Unexpected error: <*errors.errorString | 0xc000197c50>: { s: "timed out waiting for the condition", } Nov 26 07:50:36.577: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0011450e0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-apps] ReplicaSet test/e2e/framework/node/init/init.go:32 Nov 26 07:50:36.578: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] ReplicaSet dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:50:36.617 [DeferCleanup (Each)] [sig-apps] ReplicaSet tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicationController\sshould\sserve\sa\sbasic\simage\son\seach\sreplica\swith\sa\sprivate\simage$'
test/e2e/framework/pod/resource.go:103
k8s.io/kubernetes/test/e2e/framework/pod.ProxyResponseChecker.CheckAllResponses({{0x801de88, 0xc001b20000}, {0xc0048caae0, 0x1b}, {0x7fec6c0, 0xc000ac6dc8}, {0xc00516a580, 0x38}, 0x1, 0xc000248700})
test/e2e/framework/pod/resource.go:103 +0x1ca
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0000820c8?}, 0x262a61f?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0000820c8}, 0xc00262aa68, 0x2fdb16a?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0000820c8}, 0xd8?, 0x2fd9d05?, 0x58?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollWithContext({0x7fe0bc8, 0xc0000820c8}, 0x0?, 0xc0035a5728?, 0x262a967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:460 +0x47
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.Poll(0xc0035a58b0?, 0xc0035a58b0?, 0x75b77f2?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:445 +0x50
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc001262f00, {0x75bfe1c, 0x7}, {0xc004345470, 0x29})
test/e2e/apps/rc.go:512 +0x829
k8s.io/kubernetes/test/e2e/apps.glob..func8.3()
test/e2e/apps/rc.go:75 +0x190
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:50:07.347: failed to list events in namespace "replication-controller-6331": Get "https://34.83.149.76/api/v1/namespaces/replication-controller-6331/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:50:07.387: Couldn't delete ns: "replication-controller-6331": Delete "https://34.83.149.76/api/v1/namespaces/replication-controller-6331": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/replication-controller-6331", Err:(*net.OpError)(0xc0036a0d20)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] ReplicationController
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:49:49.969
Nov 26 07:49:49.969: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename replication-controller 11/26/22 07:49:49.971
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:49:50.383
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:49:50.516
[BeforeEach] [sig-apps] ReplicationController
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] ReplicationController
test/e2e/apps/rc.go:57
[It] should serve a basic image on each replica with a private image
test/e2e/apps/rc.go:71
STEP: Creating replication controller my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625 11/26/22 07:49:50.629
Nov 26 07:49:50.861: INFO: Pod name my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625: Found 0 pods out of 1
Nov 26 07:49:56.049: INFO: Pod name my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625: Found 1 pods out of 1
Nov 26 07:49:56.049: INFO: Ensuring all pods for ReplicationController "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625" are running
Nov 26 07:49:56.049: INFO: Waiting up to 5m0s for pod "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625-nshhb" in namespace "replication-controller-6331" to be "running"
Nov 26 07:49:56.144: INFO: Pod "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625-nshhb": Phase="Pending", Reason="", readiness=false. Elapsed: 95.075379ms
Nov 26 07:49:58.379: INFO: Pod "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625-nshhb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.330110379s
Nov 26 07:50:00.366: INFO: Pod "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625-nshhb": Phase="Pending", Reason="", readiness=false. Elapsed: 4.316318567s
Nov 26 07:50:02.227: INFO: Pod "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625-nshhb": Phase="Running", Reason="", readiness=true. Elapsed: 6.177310661s
Nov 26 07:50:02.227: INFO: Pod "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625-nshhb" satisfied condition "running"
Nov 26 07:50:02.227: INFO: Pod "my-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625-nshhb" is running (conditions: [{Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-11-26 07:49:50 +0000 UTC Reason: Message:}])
Nov 26 07:50:02.227: INFO: Trying to dial the pod
Nov 26 07:50:07.267: INFO: Unexpected error occurred: Get "https://34.83.149.76/api/v1/namespaces/replication-controller-6331/pods?labelSelector=name%3Dmy-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625": dial tcp 34.83.149.76:443: connect: connection refused
Nov 26 07:50:07.267: FAIL: Failed to get list of currentPods in namespace: replication-controller-6331
Unexpected error:
<*url.Error | 0xc006e87470>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/replication-controller-6331/pods?labelSelector=name%3Dmy-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625",
Err: <*net.OpError | 0xc0036a0aa0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc004959770>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc002862e20>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Get "https://34.83.149.76/api/v1/namespaces/replication-controller-6331/pods?labelSelector=name%3Dmy-hostname-private-a6799366-1f16-436e-91d3-cda93cf36625": dial tcp 34.83.149.76:443: connect: connection refused
occurred
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod.ProxyResponseChecker.CheckAllResponses({{0x801de88, 0xc001b20000}, {0xc0048caae0, 0x1b}, {0x7fec6c0, 0xc000ac6dc8}, {0xc00516a580, 0x38}, 0x1, 0xc000248700})
test/e2e/framework/pod/resource.go:103 +0x1ca
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0000820c8?}, 0x262a61f?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0000820c8}, 0xc00262aa68, 0x2fdb16a?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0000820c8}, 0xd8?, 0x2fd9d05?, 0x58?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollWithContext({0x7fe0bc8, 0xc0000820c8}, 0x0?, 0xc0035a5728?, 0x262a967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:460 +0x47
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.Poll(0xc0035a58b0?, 0xc0035a58b0?, 0x75b77f2?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:445 +0x50
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc001262f00, {0x75bfe1c, 0x7}, {0xc004345470, 0x29})
test/e2e/apps/rc.go:512 +0x829
k8s.io/kubernetes/test/e2e/apps.glob..func8.3()
test/e2e/apps/rc.go:75 +0x190
E1126 07:50:07.268193 10344 runtime.go:79] Observed a panic: types.GinkgoError{Heading:"Your Test Panicked", Message:"When you, or your assertion library, calls Ginkgo's Fail(),\nGinkgo panics to prevent subsequent assertions from running.\n\nNormally Ginkgo rescues this panic so you shouldn't see it.\n\nHowever, if you make an assertion in a goroutine, Ginkgo can't capture the panic.\nTo circumvent this, you should call\n\n\tdefer GinkgoRecover()\n\nat the top of the goroutine that caused this panic.\n\nAlternatively, you may have made an assertion outside of a Ginkgo\nleaf node (e.g. in a container node or some out-of-band function) - please move your assertion to\nan appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).", DocLink:"mental-model-how-ginkgo-handles-failure", CodeLocation:types.CodeLocation{FileName:"test/e2e/framework/pod/resource.go", LineNumber:103, FullStackTrace:"k8s.io/kubernetes/test/e2e/framework/pod.ProxyResponseChecker.CheckAllResponses({{0x801de88, 0xc001b20000}, {0xc0048caae0, 0x1b}, {0x7fec6c0, 0xc000ac6dc8}, {0xc00516a580, 0x38}, 0x1, 0xc000248700})\n\ttest/e2e/framework/pod/resource.go:103 +0x1ca\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0000820c8?}, 0x262a61f?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0000820c8}, 0xc00262aa68, 0x2fdb16a?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0000820c8}, 0xd8?, 0x2fd9d05?, 0x58?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollWithContext({0x7fe0bc8, 0xc0000820c8}, 0x0?, 0xc0035a5728?, 0x262a967?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:460 +0x47\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.Poll(0xc0035a58b0?, 0xc0035a58b0?, 0x75b77f2?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:445 +0x50\nk8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc001262f00, {0x75bfe1c, 0x7}, {0xc004345470, 0x29})\n\ttest/e2e/apps/rc.go:512 +0x829\nk8s.io/kubernetes/test/e2e/apps.glob..func8.3()\n\ttest/e2e/apps/rc.go:75 +0x190", CustomMessage:""}} (�[1m�[38;5;9mYour Test Panicked�[0m
�[38;5;243mtest/e2e/framework/pod/resource.go:103�[0m
When you, or your assertion library, calls Ginkgo's Fail(),
Ginkgo panics to prevent subsequent assertions from running.
Normally Ginkgo rescues this panic so you shouldn't see it.
However, if you make an assertion in a goroutine, Ginkgo can't capture the
panic.
To circumvent this, you should call
defer GinkgoRecover()
at the top of the goroutine that caused this panic.
Alternatively, you may have made an assertion outside of a Ginkgo
leaf node (e.g. in a container node or some out-of-band function) - please
move your assertion to
an appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).
�[1mLearn more at:�[0m
�[38;5;14m�[4mhttp://onsi.github.io/ginkgo/#mental-model-how-ginkgo-handles-failure�[0m
)
goroutine 6264 [running]:
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x70eb7e0?, 0xc000cb78f0})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc000cb78f0?})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75
panic({0x70eb7e0, 0xc000cb78f0})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2.Fail({0xc0050e6900, 0x40a}, {0xc0035a46c0?, 0x75b521a?, 0xc0035a46e0?})
vendor/github.com/onsi/ginkgo/v2/core_dsl.go:352 +0x225
k8s.io/kubernetes/test/e2e/framework.Fail({0xc001e39800, 0x3f5}, {0xc003396d18?, 0xc001e39000?, 0x262a967?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*Assertion).match(0xc0012f7880, {0x7fcc538, 0xae73300}, 0x0, {0xc002862e60, 0x2, 0x2})
vendor/github.com/onsi/gomega/internal/assertion.go:106 +0x1f0
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal.(*Assertion).NotTo(0xc0012f7880, {0x7fcc538, 0xae73300}, {0xc002862e60, 0x2, 0x2})
vendor/github.com/onsi/gomega/internal/assertion.go:74 +0xb2
k8s.io/kubernetes/test/e2e/framework/pod.expectNoErrorWithOffset(0x1?, {0x7fadf60?, 0xc006e87470?}, {0xc002862e60, 0x2, 0x2})
test/e2e/framework/pod/resource.go:69 +0xf3
k8s.io/kubernetes/test/e2e/framework/pod.expectNoError(...)
test/e2e/framework/pod/resource.go:59
k8s.io/kubernetes/test/e2e/framework/pod.ProxyResponseChecker.CheckAllResponses({{0x801de88, 0xc001b20000}, {0xc0048caae0, 0x1b}, {0x7fec6c0, 0xc000ac6dc8}, {0xc00516a580, 0x38}, 0x1, 0xc000248700})
test/e2e/framework/pod/resource.go:103 +0x1ca
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x2742871, 0x0})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe0bc8?, 0xc0000820c8?}, 0x262a61f?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.WaitForWithContext({0x7fe0bc8, 0xc0000820c8}, 0xc00262aa68, 0x2fdb16a?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:662 +0x10c
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe0bc8, 0xc0000820c8}, 0xd8?, 0x2fd9d05?, 0x58?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:596 +0x9a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollWithContext({0x7fe0bc8, 0xc0000820c8}, 0x0?, 0xc0035a5728?, 0x262a967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:460 +0x47
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.Poll(0xc0035a58b0?, 0xc0035a58b0?, 0x75b77f2?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:445 +0x50
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc001262f00, {0x75bfe1c, 0x7}, {0xc004345470, 0x29})
test/e2e/apps/rc.go:512 +0x829
k8s.io/kubernetes/test/e2e/apps.glob..func8.3()
test/e2e/apps/rc.go:75 +0x190
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0x2d591ce, 0xc0061be600})
vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 +0x1b
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 +0x98
created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 +0xe3d
[AfterEach] [sig-apps] ReplicationController
test/e2e/framework/node/init/init.go:32
Nov 26 07:50:07.268: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] ReplicationController
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] ReplicationController
dump namespaces | framework.go:196
STEP: dump namespace information after failure 11/26/22 07:50:07.307
STEP: Collecting events from namespace "replication-controller-6331". 11/26/22 07:50:07.307
Nov 26 07:50:07.347: INFO: Unexpected error: failed to list events in namespace "replication-controller-6331":
<*url.Error | 0xc0049597a0>: {
Op: "Get",
URL: "https://34.83.149.76/api/v1/namespaces/replication-controller-6331/events",
Err: <*net.OpError | 0xc003de43c0>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0032de090>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc0044fc7e0>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:50:07.347: FAIL: failed to list events in namespace "replication-controller-6331": Get "https://34.83.149.76/api/v1/namespaces/replication-controller-6331/events": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/debug.dumpEventsInNamespace(0xc0035a45c0, {0xc0048caae0, 0x1b})
test/e2e/framework/debug/dump.go:44 +0x191
k8s.io/kubernetes/test/e2e/framework/debug.DumpAllNamespaceInfo({0x801de88, 0xc001b20000}, {0xc0048caae0, 0x1b})
test/e2e/framework/debug/dump.go:62 +0x8d
k8s.io/kubernetes/test/e2e/framework/debug/init.init.0.func1.1(0xc0035a4650?, {0xc0048caae0?, 0x7fa7740?})
test/e2e/framework/debug/init/init.go:34 +0x32
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo.func1()
test/e2e/framework/framework.go:274 +0x6d
k8s.io/kubernetes/test/e2e/framework.(*Framework).dumpNamespaceInfo(0xc001262f00)
test/e2e/framework/framework.go:271 +0x179
reflect.Value.call({0x6627cc0?, 0xc001094a50?, 0xc003d00fb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0xc001b20228?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc001094a50?, 0x29449fc?}, {0xae73300?, 0xc003d00f80?, 0x2a6d786?})
/usr/local/go/src/reflect/value.go:368 +0xbc
[DeferCleanup (Each)] [sig-apps] ReplicationController
tear down framework | framework.go:193
STEP: Destroying namespace "replication-controller-6331" for this suite. 11/26/22 07:50:07.347
Nov 26 07:50:07.387: FAIL: Couldn't delete ns: "replication-controller-6331": Delete "https://34.83.149.76/api/v1/namespaces/replication-controller-6331": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/replication-controller-6331", Err:(*net.OpError)(0xc0036a0d20)})
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach.func1()
test/e2e/framework/framework.go:370 +0x4fe
k8s.io/kubernetes/test/e2e/framework.(*Framework).AfterEach(0xc001262f00)
test/e2e/framework/framework.go:383 +0x1ca
reflect.Value.call({0x6627cc0?, 0xc0010949b0?, 0xc002a2ffb0?}, {0x75b6e72, 0x4}, {0xae73300, 0x0, 0x0?})
/usr/local/go/src/reflect/value.go:584 +0x8c5
reflect.Value.Call({0x6627cc0?, 0xc0010949b0?, 0x0?}, {0xae73300?, 0x5?, 0xc004896870?})
/usr/local/go/src/reflect/value.go:368 +0xbc
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicationController\sshould\stest\sthe\slifecycle\sof\sa\sReplicationController\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0006afef0) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-apps] ReplicationController set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:12:08.865 Nov 26 07:12:08.865: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename replication-controller 11/26/22 07:12:08.867 Nov 26 07:12:08.906: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:10.947: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:12.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:14.947: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:16.947: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:18.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:20.947: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:22.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:24.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:26.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:28.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:30.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:32.947: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:34.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:36.947: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:38.946: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:38.985: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:12:38.985: INFO: Unexpected error: <*errors.errorString | 0xc000215d70>: { s: "timed out waiting for the condition", } Nov 26 07:12:38.986: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc0006afef0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-apps] ReplicationController test/e2e/framework/node/init/init.go:32 Nov 26 07:12:38.986: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] ReplicationController dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:12:39.025 [DeferCleanup (Each)] [sig-apps] ReplicationController tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sStatefulSet\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sperform\srolling\supdates\sand\sroll\sbacks\sof\stemplate\smodifications\s\[Conformance\]$'
test/e2e/framework/framework.go:241 k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000b661e0) test/e2e/framework/framework.go:241 +0x96ffrom junit_01.xml
[BeforeEach] [sig-apps] StatefulSet set up framework | framework.go:178 STEP: Creating a kubernetes client 11/26/22 07:50:07.653 Nov 26 07:50:07.653: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename statefulset 11/26/22 07:50:07.654 Nov 26 07:50:07.693: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:09.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:11.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:13.733: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:15.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:17.733: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:19.733: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:21.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:23.733: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:25.733: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:27.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:29.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:31.733: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:33.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:35.733: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:37.734: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:37.773: INFO: Unexpected error while creating namespace: Post "https://34.83.149.76/api/v1/namespaces": dial tcp 34.83.149.76:443: connect: connection refused Nov 26 07:50:37.773: INFO: Unexpected error: <*errors.errorString | 0xc0001ffa10>: { s: "timed out waiting for the condition", } Nov 26 07:50:37.773: FAIL: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/framework.(*Framework).BeforeEach(0xc000b661e0) test/e2e/framework/framework.go:241 +0x96f [AfterEach] [sig-apps] StatefulSet test/e2e/framework/node/init/init.go:32 Nov 26 07:50:37.773: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] StatefulSet dump namespaces | framework.go:196 STEP: dump namespace information after failure 11/26/22 07:50:37.813 [DeferCleanup (Each)] [sig-apps] StatefulSet tear down framework | framework.go:193
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sTTLAfterFinished\sjob\sshould\sbe\sdeleted\sonce\sit\sfinishes\safter\sTTL\sseconds$'
test/e2e/apps/ttl_after_finished.go:89
k8s.io/kubernetes/test/e2e/apps.testFinishedJob(0xc001144e10)
test/e2e/apps/ttl_after_finished.go:89 +0x305
k8s.io/kubernetes/test/e2e/apps.glob..func11.1()
test/e2e/apps/ttl_after_finished.go:49 +0x1d
There were additional failures detected after the initial failure:
[FAILED]
Nov 26 07:50:06.415: failed to list events in namespace "ttlafterfinished-5217": Get "https://34.83.149.76/api/v1/namespaces/ttlafterfinished-5217/events": dial tcp 34.83.149.76:443: connect: connection refused
In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44
----------
[FAILED]
Nov 26 07:50:06.455: Couldn't delete ns: "ttlafterfinished-5217": Delete "https://34.83.149.76/api/v1/namespaces/ttlafterfinished-5217": dial tcp 34.83.149.76:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://34.83.149.76/api/v1/namespaces/ttlafterfinished-5217", Err:(*net.OpError)(0xc00488c230)})
In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:370
[BeforeEach] [sig-apps] TTLAfterFinished
set up framework | framework.go:178
STEP: Creating a kubernetes client 11/26/22 07:49:29.467
Nov 26 07:49:29.467: INFO: >>> kubeConfig: /workspace/.kube/config
STEP: Building a namespace api object, basename ttlafterfinished 11/26/22 07:49:29.469
STEP: Waiting for a default service account to be provisioned in namespace 11/26/22 07:49:29.743
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace 11/26/22 07:49:29.917
[BeforeEach] [sig-apps] TTLAfterFinished
test/e2e/framework/metrics/init/init.go:31
[It] job should be deleted once it finishes after TTL seconds
test/e2e/apps/ttl_after_finished.go:48
Nov 26 07:49:30.060: INFO: Create a Job ttlafterfinished-5217/rand-non-local with TTL
Nov 26 07:49:30.158: INFO: Wait for the Job to finish
Nov 26 07:50:06.295: INFO: Unexpected error:
<*url.Error | 0xc006438960>: {
Op: "Get",
URL: "https://34.83.149.76/apis/batch/v1/namespaces/ttlafterfinished-5217/jobs/rand-non-local",
Err: <*net.OpError | 0xc00187f450>{
Op: "dial",
Net: "tcp",
Source: nil,
Addr: <*net.TCPAddr | 0xc0057d6990>{
IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 34, 83, 149, 76],
Port: 443,
Zone: "",
},
Err: <*os.SyscallError | 0xc001116200>{
Syscall: "connect",
Err: <syscall.Errno>0x6f,
},
},
}
Nov 26 07:50:06.295: FAIL: Get "https://34.83.149.76/apis/batch/v1/namespaces/ttlafterfinished-5217/jobs/rand-non-local": dial tcp 34.83.149.76:443: connect: connection refused
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.testFinishedJob(0xc001144e10)
test/e2e/apps/ttl_after_finished.go:89 +0x305
k8s.io/kubernet