e2e-kops-grid-gce-calico-u2004-k26 #1616623597453840384
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 10 failed / 845 succeeded |
| Started | |
| Elapsed | 37m28s |
| Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sdeny\scrd\screation\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:2041
k8s.io/kubernetes/test/e2e/apimachinery.registerValidatingWebhookForCRD(0xc0004a1e00, {0xc000c1ea00, 0xb}, 0xc000a2e1e0, 0x0?)
test/e2e/apimachinery/webhook.go:2041 +0x792
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.12()
test/e2e/apimachinery/webhook.go:309 +0x45
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:55:05.39�[0m
Jan 21 02:55:05.390: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m01/21/23 02:55:05.391�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:55:05.528�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:55:05.632�[0m
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/21/23 02:55:05.816�[0m
�[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m01/21/23 02:55:06.732�[0m
�[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m01/21/23 02:55:06.779�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/21/23 02:55:06.872�[0m
Jan 21 02:55:07.013: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 55, 6, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 55, 6, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 55, 6, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 55, 6, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
�[1mSTEP:�[0m Deploying the webhook service �[38;5;243m01/21/23 02:55:09.058�[0m
�[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m01/21/23 02:55:09.128�[0m
Jan 21 02:55:10.129: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should deny crd creation [Conformance]
test/e2e/apimachinery/webhook.go:308
�[1mSTEP:�[0m Registering the crd webhook via the AdmissionRegistration API �[38;5;243m01/21/23 02:55:10.188�[0m
Jan 21 02:55:20.762: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:55:31.011: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:55:41.218: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:55:51.363: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:56:01.463: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:56:01.463: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*errors.errorString | 0xc0001f1a20>: {
s: "timed out waiting for the condition",
}
Jan 21 02:56:01.463: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerValidatingWebhookForCRD(0xc0004a1e00, {0xc000c1ea00, 0xb}, 0xc000a2e1e0, 0x0?)
test/e2e/apimachinery/webhook.go:2041 +0x792
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.12()
test/e2e/apimachinery/webhook.go:309 +0x45
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Jan 21 02:56:01.463: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:56:01.735�[0m
�[1mSTEP:�[0m Collecting events from namespace "webhook-436". �[38;5;243m01/21/23 02:56:01.735�[0m
�[1mSTEP:�[0m Found 7 events. �[38;5;243m01/21/23 02:56:01.784�[0m
Jan 21 02:56:01.784: INFO: At 2023-01-21 02:55:06 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Jan 21 02:56:01.784: INFO: At 2023-01-21 02:55:06 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-wss6v
Jan 21 02:56:01.784: INFO: At 2023-01-21 02:55:06 +0000 UTC - event for sample-webhook-deployment-865554f4d9-wss6v: {default-scheduler } Scheduled: Successfully assigned webhook-436/sample-webhook-deployment-865554f4d9-wss6v to nodes-us-west1-a-3rdc
Jan 21 02:56:01.784: INFO: At 2023-01-21 02:55:07 +0000 UTC - event for sample-webhook-deployment-865554f4d9-wss6v: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:56:01.784: INFO: At 2023-01-21 02:55:07 +0000 UTC - event for sample-webhook-deployment-865554f4d9-wss6v: {kubelet nodes-us-west1-a-3rdc} Created: Created container sample-webhook
Jan 21 02:56:01.784: INFO: At 2023-01-21 02:55:07 +0000 UTC - event for sample-webhook-deployment-865554f4d9-wss6v: {kubelet nodes-us-west1-a-3rdc} Started: Started container sample-webhook
Jan 21 02:56:01.784: INFO: At 2023-01-21 02:56:01 +0000 UTC - event for sample-webhook-deployment-865554f4d9-wss6v: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container sample-webhook
Jan 21 02:56:01.827: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:56:01.827: INFO:
Jan 21 02:56:01.880: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:56:01.930: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 37031 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:51:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:56:01.930: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:56:01.984: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:56:02.062: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:56:02.062: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:02.062: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:56:02.062: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:56:02.062: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:56:02.062: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:56:02.062: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:02.062: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:56:02.062: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:02.062: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:56:02.062: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:56:02.062: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:56:02.062: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:02.062: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:02.062: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:02.483: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:56:02.484: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:56:02.543: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 49061 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-3836":"csi-mock-csi-mock-volumes-3836","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:55:20 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:55:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-bf08ad11-9bfd-443e-9940-cfaf11ae885d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-bf08ad11-9bfd-443e-9940-cfaf11ae885d,DevicePath:,},},Config:nil,},}
Jan 21 02:56:02.547: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:56:02.601: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:56:02.671: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:02.671: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:02.672: INFO: csi-mockplugin-0 started at 2023-01-21 02:55:13 +0000 UTC (0+4 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container busybox ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-29gdf started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-z5879 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:02.672: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container querier ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-mx92t started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-rk79z started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:02.672: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:56:02.672: INFO: ss-1 started at 2023-01-21 02:55:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-djqbc started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-bjkwv started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-2np62 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:02.672: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:02.672: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:02.672: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container coredns ready: true, restart count 0
Jan 21 02:56:02.672: INFO: csi-mockplugin-0 started at 2023-01-21 02:54:12 +0000 UTC (0+4 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container busybox ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-6qqcq started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:02.672: INFO: pvc-volume-tester-59j7g started at 2023-01-21 02:55:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container volume-tester ready: true, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-hpqpg started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:02.672: INFO: dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8 started at 2023-01-21 02:53:13 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container querier ready: true, restart count 0
Jan 21 02:56:02.672: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:02.672: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-tgljt started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:02.672: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:03.419: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:56:03.419: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:56:03.603: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 49065 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:54:55 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-67a0e4de-9c39-41c4-80ae-21d7c8c11440],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-c609d7e1-9b50-4465-a8a7-2a5b01e37ddc,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-67a0e4de-9c39-41c4-80ae-21d7c8c11440,DevicePath:,},},Config:nil,},}
Jan 21 02:56:03.603: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:56:03.719: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:56:03.844: INFO: ss-1 started at 2023-01-21 02:54:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-mww7r started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-2wft8 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:03.844: INFO: test-deployment-f4dbc4647-2bt7p started at 2023-01-21 02:55:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container test-deployment ready: false, restart count 0
Jan 21 02:56:03.844: INFO: downwardapi-volume-097d9e60-7474-44c9-aca6-80176138fce2 started at 2023-01-21 02:55:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container client-container ready: false, restart count 0
Jan 21 02:56:03.844: INFO: hostexec-nodes-us-west1-a-kvqf-l5b6r started at 2023-01-21 02:55:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:03.844: INFO: pod-projected-configmaps-b3222a98-8557-43b7-b62f-24af9829230d started at 2023-01-21 02:55:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-q67z4 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-hkt7p started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:03.844: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:03.844: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-kwkk2 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-qwm24 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:03.844: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:03.844: INFO: ss-0 started at 2023-01-21 02:54:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:03.844: INFO: suspend-false-to-true-26w58 started at 2023-01-21 02:54:54 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container c ready: true, restart count 0
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-dkk2c started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:03.844: INFO: local-injector started at 2023-01-21 02:55:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container local-injector ready: true, restart count 0
Jan 21 02:56:03.844: INFO: hostexec-nodes-us-west1-a-kvqf-zl558 started at 2023-01-21 02:55:07 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-h6896 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:03.844: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-gpvxl started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:03.844: INFO: liveness-4ed28671-3bf2-4276-b98a-81ca692dc850 started at 2023-01-21 02:54:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container agnhost-container ready: true, restart count 2
Jan 21 02:56:03.844: INFO: exec-volume-test-preprovisionedpv-wlr4 started at 2023-01-21 02:55:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container exec-container-preprovisionedpv-wlr4 ready: false, restart count 0
Jan 21 02:56:03.844: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:03.844: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:03.844: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:03.844: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:03.844: INFO: startup-4cee6943-f0a7-40da-a68f-915dda8165ca started at 2023-01-21 02:53:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:03.844: INFO: Container busybox ready: false, restart count 0
Jan 21 02:56:04.865: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:56:04.865: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:56:04.944: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 49068 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9747":"nodes-us-west1-a-m5ts","csi-mock-csi-mock-volumes-2687":"nodes-us-west1-a-m5ts","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:55:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 02:55:52 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:48 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:48 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:48 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:55:48 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2687^164e1e65-9937-11ed-b6b6-92951714f8dd kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-1ba2edce-b3d4-470c-9e9b-74974501de01 kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-c430e66e-202d-46ba-aef5-560e908aecdc],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-2687^164e1e65-9937-11ed-b6b6-92951714f8dd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-c430e66e-202d-46ba-aef5-560e908aecdc,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-1ba2edce-b3d4-470c-9e9b-74974501de01,DevicePath:,},},Config:nil,},}
Jan 21 02:56:04.945: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:56:05.011: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:56:05.095: INFO: ss-0 started at 2023-01-21 02:54:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:05.095: INFO: csi-mockplugin-0 started at 2023-01-21 02:55:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:05.095: INFO: e2e-rc-2fp4h-wn59j started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-lk9z8 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-fsgxt started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: test-deployment-f4dbc4647-vklvq started at 2023-01-21 02:55:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container test-deployment ready: true, restart count 0
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-v8dbb started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 02:55:22 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-jg6qx started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: pvc-volume-tester-m2tdp started at 2023-01-21 02:55:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container volume-tester ready: true, restart count 0
Jan 21 02:56:05.095: INFO: metadata-volume-51c349fb-30d2-4c04-ae55-bac16c3b05a0 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: ss-2 started at 2023-01-21 02:55:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-bgsgx started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: security-context-b1831fc7-7ffb-424e-bd33-71e7b0a60365 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:54:56 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-h5txc started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-w5n4r started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-9cpj5 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-cgj29 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: csi-mockplugin-resizer-0 started at 2023-01-21 02:55:22 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-qzkzf started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:05.095: INFO: hostexec-nodes-us-west1-a-m5ts-kn52k started at 2023-01-21 02:55:53 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:05.095: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-fs2gl started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:05.095: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:05.095: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:05.095: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:05.095: INFO: pod-projected-configmaps-34d8ba6c-f563-434f-8370-d2b54936777c started at 2023-01-21 02:55:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:05.095: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:06.182: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:56:06.182: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:56:06.236: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 49076 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-931":"nodes-us-west1-a-vs1n","csi-mock-csi-mock-volumes-945":"nodes-us-west1-a-vs1n","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:56:06.237: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:56:06.290: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-g6rtr started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-bqlzh started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-q95j5 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-cwv2r started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:06.404: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 02:53:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:06.404: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:06.404: INFO: csi-mockplugin-0 started at 2023-01-21 02:55:38 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:06.404: INFO: pvc-volume-tester-slnqh started at 2023-01-21 02:55:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container volume-tester ready: true, restart count 0
Jan 21 02:56:06.404: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container coredns ready: true, restart count 0
Jan 21 02:56:06.404: INFO: hostexec-nodes-us-west1-a-vs1n-ggrtv started at 2023-01-21 02:55:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-m4884 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-fjrrj started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-r9hs9 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:06.404: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:06.404: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:06.404: INFO: csi-mockplugin-0 started at 2023-01-21 02:53:20 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:06.404: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-zr8cg started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-kzk2t started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:06.404: INFO: pod-e47a7e3c-21c0-4dd7-b1a8-0a5337c7c721 started at 2023-01-21 02:55:53 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:06.404: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:56:06.404: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-7wrc4 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:07.116: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
�[1mSTEP:�[0m Collecting events from namespace "webhook-436-markers". �[38;5;243m01/21/23 02:56:07.116�[0m
�[1mSTEP:�[0m Found 0 events. �[38;5;243m01/21/23 02:56:07.167�[0m
Jan 21 02:56:07.220: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:56:07.220: INFO:
Jan 21 02:56:07.319: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:56:07.372: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 37031 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:51:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:51:37 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:56:07.373: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:56:07.443: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:56:07.534: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:56:07.534: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:07.534: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:56:07.534: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:07.534: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:56:07.534: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:56:07.534: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:56:07.534: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:56:07.534: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:07.534: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:56:07.534: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:07.534: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:07.534: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:56:07.534: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:07.534: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:56:08.117: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:56:08.117: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:56:08.179: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 49061 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-3836":"csi-mock-csi-mock-volumes-3836","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:55:20 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:55:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:55:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-bf08ad11-9bfd-443e-9940-cfaf11ae885d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-bf08ad11-9bfd-443e-9940-cfaf11ae885d,DevicePath:,},},Config:nil,},}
Jan 21 02:56:08.180: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:56:08.240: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:56:08.335: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container querier ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-mx92t started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-rk79z started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-bjkwv started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-2np62 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.335: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:56:08.335: INFO: ss-1 started at 2023-01-21 02:55:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-djqbc started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-6qqcq started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: pvc-volume-tester-59j7g started at 2023-01-21 02:55:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container volume-tester ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-hpqpg started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:08.335: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:08.335: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container coredns ready: true, restart count 0
Jan 21 02:56:08.335: INFO: dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8 started at 2023-01-21 02:53:13 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container querier ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-tgljt started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:08.335: INFO: csi-mockplugin-0 started at 2023-01-21 02:55:13 +0000 UTC (0+4 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container busybox ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:08.335: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-29gdf started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.335: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-z5879 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.335: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:08.678: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:56:08.678: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:56:08.728: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 49446 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-21 02:56:05 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:55:57 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-67a0e4de-9c39-41c4-80ae-21d7c8c11440],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-67a0e4de-9c39-41c4-80ae-21d7c8c11440,DevicePath:,},},Config:nil,},}
Jan 21 02:56:08.729: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:56:08.801: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:56:08.995: INFO: liveness-4ed28671-3bf2-4276-b98a-81ca692dc850 started at 2023-01-21 02:54:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container agnhost-container ready: true, restart count 2
Jan 21 02:56:08.995: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:08.995: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:08.995: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:08.995: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:08.995: INFO: startup-4cee6943-f0a7-40da-a68f-915dda8165ca started at 2023-01-21 02:53:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container busybox ready: false, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-mww7r started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-2wft8 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.995: INFO: test-deployment-f4dbc4647-2bt7p started at 2023-01-21 02:55:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container test-deployment ready: true, restart count 0
Jan 21 02:56:08.995: INFO: hostexec-nodes-us-west1-a-kvqf-l5b6r started at 2023-01-21 02:55:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:08.995: INFO: pod-projected-configmaps-b3222a98-8557-43b7-b62f-24af9829230d started at 2023-01-21 02:55:51 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-q67z4 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-hkt7p started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:08.995: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:08.995: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-kwkk2 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-qwm24 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.995: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:08.995: INFO: ss-0 started at 2023-01-21 02:54:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-dkk2c started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.995: INFO: e2e-rc-2fp4h-7b5fp started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:08.995: INFO: local-injector started at 2023-01-21 02:55:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container local-injector ready: true, restart count 0
Jan 21 02:56:08.995: INFO: hostexec-nodes-us-west1-a-kvqf-zl558 started at 2023-01-21 02:55:07 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-h6896 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:08.995: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-gpvxl started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:08.995: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:10.584: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:56:10.584: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:56:10.627: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 49644 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2687":"nodes-us-west1-a-m5ts","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:55:52 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-21 02:56:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:08 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:08 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:08 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:56:08 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2687^164e1e65-9937-11ed-b6b6-92951714f8dd kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-1ba2edce-b3d4-470c-9e9b-74974501de01],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-2687^164e1e65-9937-11ed-b6b6-92951714f8dd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-c430e66e-202d-46ba-aef5-560e908aecdc,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-1ba2edce-b3d4-470c-9e9b-74974501de01,DevicePath:,},},Config:nil,},}
Jan 21 02:56:10.628: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:56:10.673: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:56:10.742: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:10.742: INFO: pod-projected-configmaps-34d8ba6c-f563-434f-8370-d2b54936777c started at 2023-01-21 02:55:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:10.742: INFO: hostpath-symlink-prep-provisioning-2658 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-qzkzf started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:10.742: INFO: hostexec-nodes-us-west1-a-m5ts-kn52k started at 2023-01-21 02:55:53 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-fs2gl started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:10.742: INFO: ss-0 started at 2023-01-21 02:54:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:10.742: INFO: csi-mockplugin-0 started at 2023-01-21 02:55:22 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:10.742: INFO: e2e-rc-2fp4h-wn59j started at 2023-01-21 02:56:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container httpd ready: false, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-v8dbb started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:10.742: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 02:55:22 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-lk9z8 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-fsgxt started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: privileged-pod started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: pod-subpath-test-preprovisionedpv-c4w9 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: test-deployment-f4dbc4647-vklvq started at 2023-01-21 02:55:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container test-deployment ready: true, restart count 0
Jan 21 02:56:10.742: INFO: pvc-volume-tester-m2tdp started at 2023-01-21 02:55:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container volume-tester ready: true, restart count 0
Jan 21 02:56:10.742: INFO: metadata-volume-51c349fb-30d2-4c04-ae55-bac16c3b05a0 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: test-deployment-7df74c55ff-fhg46 started at 2023-01-21 02:56:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container test-deployment ready: false, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-jg6qx started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:10.742: INFO: ss-2 started at 2023-01-21 02:55:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container webserver ready: true, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-h5txc started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-w5n4r started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-bgsgx started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: security-context-b1831fc7-7ffb-424e-bd33-71e7b0a60365 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:54:56 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-9cpj5 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:10.742: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-cgj29 started at <nil> (0+0 container statuses recorded)
Jan 21 02:56:10.742: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:10.742: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:10.742: INFO: csi-mockplugin-resizer-0 started at 2023-01-21 02:55:22 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:10.742: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:56:11.011: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:56:11.011: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:56:11.054: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 49076 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-931":"nodes-us-west1-a-vs1n","csi-mock-csi-mock-volumes-945":"nodes-us-west1-a-vs1n","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:55:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {e2e.test Update v1 2023-01-21 02:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} }]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:55:56 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:56:11.054: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:56:11.108: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-m4884 started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-fjrrj started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-r9hs9 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-zr8cg started at 2023-01-21 02:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-kzk2t started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:56:11.169: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:56:11.169: INFO: csi-mockplugin-0 started at 2023-01-21 02:53:20 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:11.169: INFO: pod-e47a7e3c-21c0-4dd7-b1a8-0a5337c7c721 started at 2023-01-21 02:55:53 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-7wrc4 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-g6rtr started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-bqlzh started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-q95j5 started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: false, restart count 0
Jan 21 02:56:11.169: INFO: cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895-cwv2r started at 2023-01-21 02:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container cleanup40-264ccd65-69fd-4a9a-9257-b42fbb2b4895 ready: true, restart count 0
Jan 21 02:56:11.169: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 02:53:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:56:11.169: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:56:11.169: INFO: csi-mockplugin-0 started at 2023-01-21 02:55:38 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:56:11.169: INFO: Container mock ready: true, restart count 0
Jan 21 02:56:11.169: INFO: pvc-volume-tester-slnqh started at 2023-01-21 02:55:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container volume-tester ready: true, restart count 0
Jan 21 02:56:11.169: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:56:11.169: INFO: Container coredns ready: true, restart count 0
Jan 21 02:56:11.469: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "webhook-436" for this suite. �[38;5;243m01/21/23 02:56:11.469�[0m
�[1mSTEP:�[0m Destroying namespace "webhook-436-markers" for this suite. �[38;5;243m01/21/23 02:56:11.514�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\shonor\stimeout\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:2170
k8s.io/kubernetes/test/e2e/apimachinery.registerSlowWebhook(0xc000fb1e00, {0xc003cfdc40, 0xc}, 0xc002f755e0, 0xc000a7b550, 0xc000a60790, 0x291920?)
test/e2e/apimachinery/webhook.go:2170 +0x7f1
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.15()
test/e2e/apimachinery/webhook.go:386 +0xd2
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:49:42.474�[0m
Jan 21 02:49:42.474: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m01/21/23 02:49:42.475�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:49:42.637�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:49:42.719�[0m
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/21/23 02:49:42.899�[0m
�[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m01/21/23 02:49:43.424�[0m
�[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m01/21/23 02:49:43.495�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/21/23 02:49:43.615�[0m
Jan 21 02:49:43.886: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:0, UpdatedReplicas:0, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), Reason:"NewReplicaSetCreated", Message:"Created new replica set \"sample-webhook-deployment-865554f4d9\""}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Jan 21 02:49:45.945: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 49, 43, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
�[1mSTEP:�[0m Deploying the webhook service �[38;5;243m01/21/23 02:49:48.017�[0m
�[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m01/21/23 02:49:48.189�[0m
Jan 21 02:49:49.190: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should honor timeout [Conformance]
test/e2e/apimachinery/webhook.go:381
�[1mSTEP:�[0m Setting timeout (1s) shorter than webhook latency (5s) �[38;5;243m01/21/23 02:49:49.259�[0m
�[1mSTEP:�[0m Registering slow webhook via the AdmissionRegistration API �[38;5;243m01/21/23 02:49:49.259�[0m
Jan 21 02:49:59.486: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:50:09.693: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:50:19.908: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:50:30.107: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:50:40.201: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:50:40.201: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*errors.errorString | 0xc000291ca0>: {
s: "timed out waiting for the condition",
}
Jan 21 02:50:40.201: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerSlowWebhook(0xc000fb1e00, {0xc003cfdc40, 0xc}, 0xc002f755e0, 0xc000a7b550, 0xc000a60790, 0x291920?)
test/e2e/apimachinery/webhook.go:2170 +0x7f1
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.15()
test/e2e/apimachinery/webhook.go:386 +0xd2
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Jan 21 02:50:40.202: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:50:40.492�[0m
�[1mSTEP:�[0m Collecting events from namespace "webhook-5169". �[38;5;243m01/21/23 02:50:40.492�[0m
�[1mSTEP:�[0m Found 7 events. �[38;5;243m01/21/23 02:50:40.536�[0m
Jan 21 02:50:40.536: INFO: At 2023-01-21 02:49:43 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Jan 21 02:50:40.536: INFO: At 2023-01-21 02:49:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-rz9h2
Jan 21 02:50:40.536: INFO: At 2023-01-21 02:49:43 +0000 UTC - event for sample-webhook-deployment-865554f4d9-rz9h2: {default-scheduler } Scheduled: Successfully assigned webhook-5169/sample-webhook-deployment-865554f4d9-rz9h2 to nodes-us-west1-a-3rdc
Jan 21 02:50:40.536: INFO: At 2023-01-21 02:49:45 +0000 UTC - event for sample-webhook-deployment-865554f4d9-rz9h2: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:50:40.536: INFO: At 2023-01-21 02:49:45 +0000 UTC - event for sample-webhook-deployment-865554f4d9-rz9h2: {kubelet nodes-us-west1-a-3rdc} Created: Created container sample-webhook
Jan 21 02:50:40.536: INFO: At 2023-01-21 02:49:45 +0000 UTC - event for sample-webhook-deployment-865554f4d9-rz9h2: {kubelet nodes-us-west1-a-3rdc} Started: Started container sample-webhook
Jan 21 02:50:40.536: INFO: At 2023-01-21 02:50:40 +0000 UTC - event for sample-webhook-deployment-865554f4d9-rz9h2: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container sample-webhook
Jan 21 02:50:40.591: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:50:40.591: INFO:
Jan 21 02:50:40.639: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:50:40.683: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 22571 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:46:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:50:40.683: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:50:40.732: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:50:40.800: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:50:40.801: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:40.801: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:50:40.801: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:40.801: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:50:40.801: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:50:40.801: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:50:40.801: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:50:40.801: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:40.801: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:50:40.801: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:40.801: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:40.801: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:50:40.801: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:40.801: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:50:41.147: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:50:41.147: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:50:41.191: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 33108 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:50:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:50:41.191: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:50:41.247: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:50:41.325: INFO: pod-0 started at 2023-01-21 02:49:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:41.325: INFO: test-webserver-a41601c4-3ea2-41a5-846c-550e5c70e2e9 started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container test-webserver ready: true, restart count 0
Jan 21 02:50:41.325: INFO: pod-2 started at 2023-01-21 02:49:42 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:41.325: INFO: execpodlb7ht started at 2023-01-21 02:50:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:50:41.325: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:50:41.325: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:41.325: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:41.325: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:41.325: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container coredns ready: true, restart count 0
Jan 21 02:50:41.325: INFO: hostexec-nodes-us-west1-a-3rdc-c5bhp started at 2023-01-21 02:50:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:50:41.325: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:41.325: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:41.325: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:41.325: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:41.325: INFO: webserver-pod started at 2023-01-21 02:46:09 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container agnhost ready: false, restart count 0
Jan 21 02:50:41.325: INFO: pod-1 started at 2023-01-21 02:50:36 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:41.325: INFO: netserver-0 started at 2023-01-21 02:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:41.325: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:50:41.325: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:50:41.325: INFO: Container querier ready: true, restart count 0
Jan 21 02:50:41.325: INFO: Container webserver ready: true, restart count 0
Jan 21 02:50:41.592: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:50:41.592: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:50:41.641: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 33337 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-7269":"nodes-us-west1-a-kvqf","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:50:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:50:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-7269^47ba39c6-9936-11ed-a191-fa7134f3118a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-7269^47ba39c6-9936-11ed-a191-fa7134f3118a,DevicePath:,},},Config:nil,},}
Jan 21 02:50:41.641: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:50:41.697: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:50:41.759: INFO: pod-7f71e36a-8ead-4fbe-9728-884680c8d366 started at 2023-01-21 02:49:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:50:41.759: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:41.759: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:41.759: INFO: pod-client started at 2023-01-21 02:50:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container pod-client ready: true, restart count 0
Jan 21 02:50:41.759: INFO: hostexec-nodes-us-west1-a-kvqf-kwd4z started at 2023-01-21 02:50:30 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:41.759: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:41.759: INFO: pod-subpath-test-preprovisionedpv-4sc4 started at 2023-01-21 02:50:39 +0000 UTC (2+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Init container init-volume-preprovisionedpv-4sc4 ready: false, restart count 0
Jan 21 02:50:41.759: INFO: Init container test-init-volume-preprovisionedpv-4sc4 ready: false, restart count 0
Jan 21 02:50:41.759: INFO: Container test-container-subpath-preprovisionedpv-4sc4 ready: false, restart count 0
Jan 21 02:50:41.759: INFO: hostexec-nodes-us-west1-a-kvqf-mbtck started at 2023-01-21 02:50:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:41.759: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:49:44 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:50:41.759: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:50:41.759: INFO: deployment-shared-unset-7cf876c5d4-6q4bv started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:41.759: INFO: Container nginx ready: false, restart count 0
Jan 21 02:50:41.759: INFO: netserver-1 started at <nil> (0+0 container statuses recorded)
Jan 21 02:50:42.094: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:50:42.094: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:50:42.142: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 33393 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:50:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 02:50:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-8f72d3bd-0a81-4771-808f-8d6ba9903a93],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-8f72d3bd-0a81-4771-808f-8d6ba9903a93,DevicePath:,},},Config:nil,},}
Jan 21 02:50:42.143: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:50:42.202: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:50:42.263: INFO: nodeport-test-b4srg started at 2023-01-21 02:50:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container nodeport-test ready: true, restart count 0
Jan 21 02:50:42.263: INFO: pod-ephm-test-projected-2d7v started at 2023-01-21 02:50:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container test-container-subpath-projected-2d7v ready: false, restart count 0
Jan 21 02:50:42.263: INFO: ss-0 started at 2023-01-21 02:50:28 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:42.263: INFO: test-ss-0 started at 2023-01-21 02:50:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container webserver ready: true, restart count 0
Jan 21 02:50:42.263: INFO: pod-2 started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:42.263: INFO: deployment-shared-unset-7cf876c5d4-2qhvw started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container nginx ready: false, restart count 0
Jan 21 02:50:42.263: INFO: externalip-test-l7pqm started at 2023-01-21 02:50:29 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container externalip-test ready: true, restart count 0
Jan 21 02:50:42.263: INFO: pod-0 started at 2023-01-21 02:50:36 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:42.263: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:42.263: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:42.263: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:42.263: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:42.263: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:42.263: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:42.263: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:42.263: INFO: netserver-2 started at 2023-01-21 02:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:42.263: INFO: liveness-888e42f2-81d8-4785-8c03-000ab67a5531 started at 2023-01-21 02:50:28 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:42.263: INFO: hostexec-nodes-us-west1-a-m5ts-5nkj7 started at 2023-01-21 02:50:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:42.263: INFO: test-grpc-8df3911d-2903-4bb9-8802-2afe4515d92a started at 2023-01-21 02:48:36 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.263: INFO: Container etcd ready: true, restart count 0
Jan 21 02:50:42.512: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:50:42.512: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:50:42.560: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 32243 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:50:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:50:42.561: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:50:42.612: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:50:42.679: INFO: nodeport-test-dfbbp started at 2023-01-21 02:50:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container nodeport-test ready: true, restart count 0
Jan 21 02:50:42.680: INFO: hostexec-nodes-us-west1-a-vs1n-4ww4c started at 2023-01-21 02:50:28 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:42.680: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:42.680: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:42.680: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container coredns ready: true, restart count 0
Jan 21 02:50:42.680: INFO: netserver-3 started at 2023-01-21 02:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:42.680: INFO: hostexec-nodes-us-west1-a-vs1n-dcvps started at 2023-01-21 02:50:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:42.680: INFO: hostpath-symlink-prep-provisioning-9921 started at 2023-01-21 02:50:30 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container init-volume-provisioning-9921 ready: false, restart count 0
Jan 21 02:50:42.680: INFO: hostpath-symlink-prep-provisioning-9980 started at 2023-01-21 02:50:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container init-volume-provisioning-9980 ready: false, restart count 0
Jan 21 02:50:42.680: INFO: pod-1 started at 2023-01-21 02:49:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:42.680: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:42.680: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:42.680: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:42.680: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:42.680: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:42.680: INFO: pod-server-1 started at 2023-01-21 02:50:35 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:42.680: INFO: busybox-2311429e-d0fc-490f-aeed-dd812771e0cb started at 2023-01-21 02:49:42 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container busybox ready: true, restart count 0
Jan 21 02:50:42.680: INFO: successful-jobs-history-limit-27904490-dpq6m started at 2023-01-21 02:50:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container c ready: false, restart count 0
Jan 21 02:50:42.680: INFO: externalip-test-9g2jn started at 2023-01-21 02:50:29 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container externalip-test ready: true, restart count 0
Jan 21 02:50:42.680: INFO: pod-c0c4a1bc-6bea-4ffe-80cb-49cad70cc6d2 started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container write-pod ready: false, restart count 0
Jan 21 02:50:42.680: INFO: local-injector started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:42.680: INFO: Container local-injector ready: false, restart count 0
Jan 21 02:50:43.532: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
�[1mSTEP:�[0m Collecting events from namespace "webhook-5169-markers". �[38;5;243m01/21/23 02:50:43.532�[0m
�[1mSTEP:�[0m Found 0 events. �[38;5;243m01/21/23 02:50:43.575�[0m
Jan 21 02:50:43.619: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:50:43.619: INFO:
Jan 21 02:50:43.671: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:50:43.719: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 22571 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:46:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:50:43.719: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:50:43.776: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:50:43.839: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:50:43.839: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:50:43.839: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:43.839: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:50:43.839: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:43.839: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:50:43.839: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:50:43.839: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:50:43.839: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:43.839: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:43.839: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:50:43.839: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:43.839: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:50:43.839: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:43.839: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:50:44.314: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:50:44.314: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:50:44.359: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 33108 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:50:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:50:44.359: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:50:44.413: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:50:44.481: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:50:44.481: INFO: Container querier ready: true, restart count 0
Jan 21 02:50:44.481: INFO: Container webserver ready: true, restart count 0
Jan 21 02:50:44.481: INFO: test-webserver-a41601c4-3ea2-41a5-846c-550e5c70e2e9 started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container test-webserver ready: true, restart count 0
Jan 21 02:50:44.481: INFO: pod-2 started at 2023-01-21 02:49:42 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:44.481: INFO: execpodlb7ht started at 2023-01-21 02:50:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:44.481: INFO: pod-0 started at 2023-01-21 02:49:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:44.481: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:50:44.481: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:44.481: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:44.481: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container coredns ready: true, restart count 0
Jan 21 02:50:44.481: INFO: hostexec-nodes-us-west1-a-3rdc-c5bhp started at 2023-01-21 02:50:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:44.481: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:44.481: INFO: webserver-pod started at 2023-01-21 02:46:09 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container agnhost ready: false, restart count 0
Jan 21 02:50:44.481: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:44.481: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:44.481: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:44.481: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:44.481: INFO: netserver-0 started at 2023-01-21 02:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:44.481: INFO: pod-1 started at 2023-01-21 02:50:36 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.481: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:44.764: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:50:44.764: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:50:44.811: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 33337 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-7269":"nodes-us-west1-a-kvqf","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:50:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:50:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-7269^47ba39c6-9936-11ed-a191-fa7134f3118a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-7269^47ba39c6-9936-11ed-a191-fa7134f3118a,DevicePath:,},},Config:nil,},}
Jan 21 02:50:44.812: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:50:44.861: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:50:44.918: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:49:44 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:50:44.918: INFO: deployment-shared-unset-7cf876c5d4-6q4bv started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container nginx ready: false, restart count 0
Jan 21 02:50:44.918: INFO: netserver-1 started at 2023-01-21 02:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:44.918: INFO: pod-7f71e36a-8ead-4fbe-9728-884680c8d366 started at 2023-01-21 02:49:55 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:50:44.918: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:44.918: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:44.918: INFO: pod-client started at 2023-01-21 02:50:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container pod-client ready: true, restart count 0
Jan 21 02:50:44.918: INFO: hostexec-nodes-us-west1-a-kvqf-kwd4z started at 2023-01-21 02:50:30 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:44.918: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:44.918: INFO: pod-subpath-test-preprovisionedpv-4sc4 started at 2023-01-21 02:50:39 +0000 UTC (2+1 container statuses recorded)
Jan 21 02:50:44.918: INFO: Init container init-volume-preprovisionedpv-4sc4 ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Init container test-init-volume-preprovisionedpv-4sc4 ready: true, restart count 0
Jan 21 02:50:44.918: INFO: Container test-container-subpath-preprovisionedpv-4sc4 ready: false, restart count 0
Jan 21 02:50:45.237: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:50:45.237: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:50:45.280: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 33393 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:50:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 02:50:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-8f72d3bd-0a81-4771-808f-8d6ba9903a93],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-8f72d3bd-0a81-4771-808f-8d6ba9903a93,DevicePath:,},},Config:nil,},}
Jan 21 02:50:45.280: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:50:45.327: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:50:45.380: INFO: pod-ephm-test-projected-2d7v started at 2023-01-21 02:50:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container test-container-subpath-projected-2d7v ready: false, restart count 0
Jan 21 02:50:45.380: INFO: ss-0 started at 2023-01-21 02:50:28 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:45.380: INFO: test-ss-0 started at 2023-01-21 02:50:31 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container webserver ready: true, restart count 0
Jan 21 02:50:45.380: INFO: pod-2 started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:45.380: INFO: deployment-shared-unset-7cf876c5d4-2qhvw started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container nginx ready: false, restart count 0
Jan 21 02:50:45.380: INFO: externalip-test-l7pqm started at 2023-01-21 02:50:29 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container externalip-test ready: true, restart count 0
Jan 21 02:50:45.380: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:45.380: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:45.380: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:45.380: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:45.380: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:45.380: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:45.380: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:45.380: INFO: netserver-2 started at 2023-01-21 02:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:45.380: INFO: liveness-888e42f2-81d8-4785-8c03-000ab67a5531 started at 2023-01-21 02:50:28 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:45.380: INFO: hostexec-nodes-us-west1-a-m5ts-5nkj7 started at 2023-01-21 02:50:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:45.380: INFO: pod-65dfc15a-5c43-4562-8f97-520167daa49d started at <nil> (0+0 container statuses recorded)
Jan 21 02:50:45.380: INFO: test-grpc-8df3911d-2903-4bb9-8802-2afe4515d92a started at 2023-01-21 02:48:36 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.380: INFO: Container etcd ready: true, restart count 0
Jan 21 02:50:45.642: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:50:45.642: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:50:45.691: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 32243 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:50:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:50:45.691: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:50:45.751: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:50:45.918: INFO: nodeport-test-dfbbp started at 2023-01-21 02:50:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container nodeport-test ready: true, restart count 0
Jan 21 02:50:45.918: INFO: hostexec-nodes-us-west1-a-vs1n-4ww4c started at 2023-01-21 02:50:28 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:45.918: INFO: pod-subpath-test-inlinevolume-h95f started at 2023-01-21 02:50:43 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container test-container-subpath-inlinevolume-h95f ready: false, restart count 0
Jan 21 02:50:45.918: INFO: Container test-container-volume-inlinevolume-h95f ready: false, restart count 0
Jan 21 02:50:45.918: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:50:45.918: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:50:45.918: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container coredns ready: true, restart count 0
Jan 21 02:50:45.918: INFO: netserver-3 started at 2023-01-21 02:50:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container webserver ready: false, restart count 0
Jan 21 02:50:45.918: INFO: hostexec-nodes-us-west1-a-vs1n-dcvps started at 2023-01-21 02:50:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:45.918: INFO: hostpath-symlink-prep-provisioning-9980 started at 2023-01-21 02:50:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container init-volume-provisioning-9980 ready: false, restart count 0
Jan 21 02:50:45.918: INFO: pod-1 started at 2023-01-21 02:49:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container donothing ready: true, restart count 0
Jan 21 02:50:45.918: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:50:45.918: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:50:45.918: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:50:45.918: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:50:45.918: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:50:45.918: INFO: pod-server-1 started at 2023-01-21 02:50:35 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:50:45.918: INFO: busybox-2311429e-d0fc-490f-aeed-dd812771e0cb started at 2023-01-21 02:49:42 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container busybox ready: true, restart count 0
Jan 21 02:50:45.918: INFO: successful-jobs-history-limit-27904490-dpq6m started at 2023-01-21 02:50:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container c ready: false, restart count 0
Jan 21 02:50:45.918: INFO: externalip-test-9g2jn started at 2023-01-21 02:50:29 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container externalip-test ready: true, restart count 0
Jan 21 02:50:45.918: INFO: pod-c0c4a1bc-6bea-4ffe-80cb-49cad70cc6d2 started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:50:45.918: INFO: local-injector started at 2023-01-21 02:50:37 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:50:45.918: INFO: Container local-injector ready: true, restart count 0
Jan 21 02:50:47.005: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "webhook-5169" for this suite. �[38;5;243m01/21/23 02:50:47.005�[0m
�[1mSTEP:�[0m Destroying namespace "webhook-5169-markers" for this suite. �[38;5;243m01/21/23 02:50:47.054�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\spruning\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:1808
k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc0008e9e00, {0xc0043ab6c0, 0xc}, 0xc00426ae10, 0xc000d762a0, 0x2d5ce47?)
test/e2e/apimachinery/webhook.go:1808 +0xd51
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.14()
test/e2e/apimachinery/webhook.go:367 +0xdc
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:40:04.531�[0m
Jan 21 02:40:04.531: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m01/21/23 02:40:04.532�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:40:04.777�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:40:04.87�[0m
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/21/23 02:40:05.08�[0m
�[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m01/21/23 02:40:05.371�[0m
�[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m01/21/23 02:40:05.419�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/21/23 02:40:05.514�[0m
Jan 21 02:40:05.687: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 21 02:40:07.737: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 21 02:40:09.771: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 21 02:40:11.742: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 21 02:40:13.744: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 21, 2, 40, 5, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
�[1mSTEP:�[0m Deploying the webhook service �[38;5;243m01/21/23 02:40:15.739�[0m
�[1mSTEP:�[0m Verifying the service has paired with the endpoint �[38;5;243m01/21/23 02:40:15.803�[0m
Jan 21 02:40:16.804: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1
[It] should mutate custom resource with pruning [Conformance]
test/e2e/apimachinery/webhook.go:341
Jan 21 02:40:16.851: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Registering the mutating webhook for custom resource e2e-test-webhook-5261-crds.webhook.example.com via the AdmissionRegistration API �[38;5;243m01/21/23 02:40:17.532�[0m
Jan 21 02:40:27.673: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:40:37.887: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:40:48.079: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:40:58.268: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:41:08.418: INFO: Waiting for webhook configuration to be ready...
Jan 21 02:41:08.419: INFO: Unexpected error: waiting for webhook configuration to be ready:
<*errors.errorString | 0xc000243a10>: {
s: "timed out waiting for the condition",
}
Jan 21 02:41:08.419: FAIL: waiting for webhook configuration to be ready: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc0008e9e00, {0xc0043ab6c0, 0xc}, 0xc00426ae10, 0xc000d762a0, 0x2d5ce47?)
test/e2e/apimachinery/webhook.go:1808 +0xd51
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.14()
test/e2e/apimachinery/webhook.go:367 +0xdc
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Jan 21 02:41:09.178: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:41:10.798�[0m
�[1mSTEP:�[0m Collecting events from namespace "webhook-1143". �[38;5;243m01/21/23 02:41:10.798�[0m
�[1mSTEP:�[0m Found 6 events. �[38;5;243m01/21/23 02:41:11.152�[0m
Jan 21 02:41:11.152: INFO: At 2023-01-21 02:40:05 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Jan 21 02:41:11.152: INFO: At 2023-01-21 02:40:05 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-vxws5
Jan 21 02:41:11.152: INFO: At 2023-01-21 02:40:05 +0000 UTC - event for sample-webhook-deployment-865554f4d9-vxws5: {default-scheduler } Scheduled: Successfully assigned webhook-1143/sample-webhook-deployment-865554f4d9-vxws5 to nodes-us-west1-a-3rdc
Jan 21 02:41:11.152: INFO: At 2023-01-21 02:40:07 +0000 UTC - event for sample-webhook-deployment-865554f4d9-vxws5: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:41:11.152: INFO: At 2023-01-21 02:40:07 +0000 UTC - event for sample-webhook-deployment-865554f4d9-vxws5: {kubelet nodes-us-west1-a-3rdc} Created: Created container sample-webhook
Jan 21 02:41:11.152: INFO: At 2023-01-21 02:40:07 +0000 UTC - event for sample-webhook-deployment-865554f4d9-vxws5: {kubelet nodes-us-west1-a-3rdc} Started: Started container sample-webhook
Jan 21 02:41:11.534: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:41:11.534: INFO: sample-webhook-deployment-865554f4d9-vxws5 nodes-us-west1-a-3rdc Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:40:05 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:40:08 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:40:08 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:40:05 +0000 UTC }]
Jan 21 02:41:11.534: INFO:
Jan 21 02:41:12.438: INFO: Unable to fetch webhook-1143/sample-webhook-deployment-865554f4d9-vxws5/sample-webhook logs: the server could not find the requested resource (get pods sample-webhook-deployment-865554f4d9-vxws5)
Jan 21 02:41:12.728: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:41:13.632: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 1012 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:36:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:13.632: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:41:15.293: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:41:16.334: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:16.334: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:41:16.334: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:41:16.334: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:41:16.334: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:16.334: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:41:16.334: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:41:16.334: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:41:16.334: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:41:16.334: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:41:16.334: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:16.334: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:41:16.334: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:16.334: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:16.334: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:16.932: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:41:16.932: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:41:17.050: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 7490 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7342":"nodes-us-west1-a-3rdc","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:40:30 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:41:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7342^f1d151f6-9934-11ed-915b-fa898c23ebc4 kubernetes.io/csi/csi-hostpath-ephemeral-7342^f78e04b1-9934-11ed-915b-fa898c23ebc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7342^f78e04b1-9934-11ed-915b-fa898c23ebc4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7342^f1d151f6-9934-11ed-915b-fa898c23ebc4,DevicePath:,},},Config:nil,},}
Jan 21 02:41:17.050: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:41:17.199: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:41:17.328: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:17.328: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:17.328: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container coredns ready: true, restart count 0
Jan 21 02:41:17.328: INFO: inline-volume-tester-9c6zk started at 2023-01-21 02:40:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 21 02:41:17.328: INFO: webserver-pod started at 2023-01-21 02:39:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container agnhost ready: false, restart count 0
Jan 21 02:41:17.328: INFO: inline-volume-tester2-wfd88 started at 2023-01-21 02:40:30 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 21 02:41:17.328: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 02:41:09 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container csi-attacher ready: false, restart count 0
Jan 21 02:41:17.328: INFO: csi-mockplugin-resizer-0 started at 2023-01-21 02:41:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container csi-resizer ready: false, restart count 0
Jan 21 02:41:17.328: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:17.328: INFO: deployment-74d7dd69db-s5957 started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container nginx ready: true, restart count 0
Jan 21 02:41:17.328: INFO: csi-mockplugin-0 started at 2023-01-21 02:41:09 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container csi-provisioner ready: false, restart count 0
Jan 21 02:41:17.328: INFO: Container driver-registrar ready: false, restart count 0
Jan 21 02:41:17.328: INFO: Container mock ready: false, restart count 0
Jan 21 02:41:17.328: INFO: update-demo-nautilus-8lg8d started at 2023-01-21 02:39:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container update-demo ready: true, restart count 0
Jan 21 02:41:17.328: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:40:12 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:41:17.328: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:41:17.328: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:41:17.328: INFO: hostexec-nodes-us-west1-a-3rdc-rbkmw started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:17.328: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:41:17.700: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:41:17.700: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:41:17.790: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 7515 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:41:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:17.790: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:41:17.904: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:41:18.001: INFO: hostexec-nodes-us-west1-a-kvqf-dxv98 started at 2023-01-21 02:40:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:18.001: INFO: dns-test-08510698-97f3-442b-8887-7bbf3d8b7b3f started at 2023-01-21 02:40:52 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container querier ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container webserver ready: true, restart count 0
Jan 21 02:41:18.001: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:18.001: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:18.001: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:18.001: INFO: pod-subpath-test-preprovisionedpv-5t47 started at 2023-01-21 02:41:09 +0000 UTC (2+1 container statuses recorded)
Jan 21 02:41:18.001: INFO: Init container init-volume-preprovisionedpv-5t47 ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Init container test-init-volume-preprovisionedpv-5t47 ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Container test-container-subpath-preprovisionedpv-5t47 ready: false, restart count 0
Jan 21 02:41:18.001: INFO: inline-volume-tester-sbvkj started at <nil> (0+0 container statuses recorded)
Jan 21 02:41:18.001: INFO: run-log-test started at 2023-01-21 02:40:54 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container run-log-test ready: false, restart count 0
Jan 21 02:41:18.001: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:18.001: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:40:10 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:41:18.001: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:41:18.001: INFO: deployment-74d7dd69db-zv558 started at 2023-01-21 02:41:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container nginx ready: true, restart count 0
Jan 21 02:41:18.001: INFO: test-webserver-aca935cf-70d2-433a-af64-c17560624c01 started at 2023-01-21 02:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container test-webserver ready: false, restart count 0
Jan 21 02:41:18.001: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:41:17 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:41:18.001: INFO: Container csi-attacher ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Container csi-provisioner ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Container csi-resizer ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Container hostpath ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Container liveness-probe ready: false, restart count 0
Jan 21 02:41:18.001: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 21 02:41:18.699: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:41:18.699: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:41:18.807: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 7367 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:41:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:18.807: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:41:18.906: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:41:19.062: INFO: indexed-job-3-2zp8z started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container c ready: false, restart count 0
Jan 21 02:41:19.062: INFO: pod-client started at 2023-01-21 02:40:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container pod-client ready: true, restart count 0
Jan 21 02:41:19.062: INFO: deployment-74d7dd69db-wrgbz started at 2023-01-21 02:41:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container nginx ready: false, restart count 0
Jan 21 02:41:19.062: INFO: indexed-job-2-pgxdg started at 2023-01-21 02:41:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container c ready: false, restart count 0
Jan 21 02:41:19.062: INFO: update-demo-nautilus-j9928 started at 2023-01-21 02:39:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container update-demo ready: true, restart count 0
Jan 21 02:41:19.062: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:19.062: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:19.062: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:19.062: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:19.062: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:19.062: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:19.062: INFO: nodeport-update-service-4svpk started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container nodeport-update-service ready: true, restart count 0
Jan 21 02:41:19.062: INFO: pod-ephm-test-configmap-htck started at 2023-01-21 02:41:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container test-container-subpath-configmap-htck ready: false, restart count 0
Jan 21 02:41:19.062: INFO: httpd started at 2023-01-21 02:40:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container httpd ready: true, restart count 0
Jan 21 02:41:19.062: INFO: execpodvvd84 started at 2023-01-21 02:41:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:41:19.062: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:19.062: INFO: pod-0 started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container donothing ready: false, restart count 0
Jan 21 02:41:19.062: INFO: pod-ephm-test-secret-qkqc started at 2023-01-21 02:40:54 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container test-container-subpath-secret-qkqc ready: false, restart count 0
Jan 21 02:41:19.062: INFO: busybox-privileged-true-b4f69f64-b26e-49bf-862d-3582f5166ffc started at 2023-01-21 02:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container busybox-privileged-true-b4f69f64-b26e-49bf-862d-3582f5166ffc ready: false, restart count 0
Jan 21 02:41:19.062: INFO: indexed-job-0-bwwzg started at 2023-01-21 02:41:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container c ready: false, restart count 0
Jan 21 02:41:19.062: INFO: indexed-job-1-x889v started at 2023-01-21 02:41:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:19.062: INFO: Container c ready: false, restart count 0
Jan 21 02:41:19.758: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:41:19.758: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:41:19.851: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 6842 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:41:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:19.852: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:41:19.986: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:41:20.067: INFO: liveness-c0362e42-cbf4-446a-a0a9-e4c308379179 started at 2023-01-21 02:39:14 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:20.067: INFO: hostexec-nodes-us-west1-a-vs1n-jllnz started at 2023-01-21 02:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:20.067: INFO: nodeport-update-service-72dkh started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container nodeport-update-service ready: true, restart count 0
Jan 21 02:41:20.067: INFO: pod-c870c033-2a13-4a44-9343-640fab2030d9 started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:41:20.067: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:20.067: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:20.067: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:20.067: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:20.067: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:20.067: INFO: pod-server-2 started at 2023-01-21 02:40:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:20.067: INFO: run-test-2 started at 2023-01-21 02:41:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container run-test-2 ready: false, restart count 0
Jan 21 02:41:20.067: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:20.067: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:20.067: INFO: alpine-nnp-true-a2345f49-1044-407a-afd9-91eccba198a3 started at 2023-01-21 02:41:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container alpine-nnp-true-a2345f49-1044-407a-afd9-91eccba198a3 ready: false, restart count 0
Jan 21 02:41:20.067: INFO: deployment-74d7dd69db-qcdtj started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container nginx ready: false, restart count 0
Jan 21 02:41:20.067: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container coredns ready: true, restart count 0
Jan 21 02:41:20.067: INFO: pod-terminate-status-0-13 started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:20.067: INFO: Container fail ready: false, restart count 0
Jan 21 02:41:21.003: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
�[1mSTEP:�[0m Collecting events from namespace "webhook-1143-markers". �[38;5;243m01/21/23 02:41:21.003�[0m
�[1mSTEP:�[0m Found 0 events. �[38;5;243m01/21/23 02:41:21.05�[0m
Jan 21 02:41:21.096: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:41:21.096: INFO:
Jan 21 02:41:21.174: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:41:21.251: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 1012 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:36:17 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:36:17 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:21.252: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:41:21.349: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:41:21.426: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:41:21.426: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:41:21.426: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:41:21.426: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:21.426: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:41:21.426: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:21.426: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:41:21.426: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:41:21.426: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:41:21.426: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:41:21.426: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:41:21.426: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:21.426: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:21.426: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:41:21.426: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:41:21.426: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:21.965: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:41:21.965: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:41:22.098: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 7775 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7342":"nodes-us-west1-a-3rdc","csi-mock-csi-mock-volumes-6693":"nodes-us-west1-a-3rdc","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:40:30 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:41:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:41:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7342^f1d151f6-9934-11ed-915b-fa898c23ebc4 kubernetes.io/csi/csi-hostpath-ephemeral-7342^f78e04b1-9934-11ed-915b-fa898c23ebc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7342^f78e04b1-9934-11ed-915b-fa898c23ebc4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7342^f1d151f6-9934-11ed-915b-fa898c23ebc4,DevicePath:,},},Config:nil,},}
Jan 21 02:41:22.099: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:41:22.162: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:41:22.249: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 02:41:09 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:41:22.249: INFO: csi-mockplugin-resizer-0 started at 2023-01-21 02:41:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:41:22.249: INFO: csi-mockplugin-0 started at 2023-01-21 02:41:09 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container driver-registrar ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container mock ready: true, restart count 0
Jan 21 02:41:22.249: INFO: update-demo-nautilus-8lg8d started at 2023-01-21 02:39:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container update-demo ready: true, restart count 0
Jan 21 02:41:22.249: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:40:12 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:41:22.249: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:22.249: INFO: hostexec-nodes-us-west1-a-3rdc-rbkmw started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:22.249: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:41:22.249: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:22.249: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:22.249: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container coredns ready: true, restart count 0
Jan 21 02:41:22.249: INFO: inline-volume-tester-9c6zk started at 2023-01-21 02:40:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 21 02:41:22.249: INFO: webserver-pod started at 2023-01-21 02:39:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container agnhost ready: false, restart count 0
Jan 21 02:41:22.249: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.249: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:22.574: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:41:22.574: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:41:22.653: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 7822 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6559":"nodes-us-west1-a-kvqf","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:41:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:41:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:22.653: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:41:22.712: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:41:22.806: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:22.806: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:22.806: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:22.806: INFO: pod-subpath-test-preprovisionedpv-5t47 started at 2023-01-21 02:41:09 +0000 UTC (2+1 container statuses recorded)
Jan 21 02:41:22.806: INFO: Init container init-volume-preprovisionedpv-5t47 ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Init container test-init-volume-preprovisionedpv-5t47 ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Container test-container-subpath-preprovisionedpv-5t47 ready: false, restart count 0
Jan 21 02:41:22.806: INFO: inline-volume-tester-sbvkj started at 2023-01-21 02:41:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 21 02:41:22.806: INFO: hostexec-nodes-us-west1-a-kvqf-dxv98 started at 2023-01-21 02:40:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:22.806: INFO: dns-test-08510698-97f3-442b-8887-7bbf3d8b7b3f started at 2023-01-21 02:40:52 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Container querier ready: true, restart count 0
Jan 21 02:41:22.806: INFO: Container webserver ready: true, restart count 0
Jan 21 02:41:22.806: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:41:19 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container csi-attacher ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container csi-provisioner ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container csi-resizer ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container hostpath ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container liveness-probe ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 21 02:41:22.806: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:22.806: INFO: test-webserver-aca935cf-70d2-433a-af64-c17560624c01 started at 2023-01-21 02:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container test-webserver ready: false, restart count 0
Jan 21 02:41:22.806: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:41:17 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:41:22.806: INFO: Container csi-attacher ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container csi-provisioner ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container csi-resizer ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container hostpath ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container liveness-probe ready: false, restart count 0
Jan 21 02:41:22.806: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 21 02:41:23.295: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:41:23.295: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:41:23.339: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 7367 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:41:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:41:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:23.339: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:41:23.390: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:41:23.443: INFO: indexed-job-3-2zp8z started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container c ready: false, restart count 0
Jan 21 02:41:23.443: INFO: condition-test-btq9q started at 2023-01-21 02:41:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container httpd ready: true, restart count 0
Jan 21 02:41:23.443: INFO: indexed-job-2-pgxdg started at 2023-01-21 02:41:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container c ready: false, restart count 0
Jan 21 02:41:23.443: INFO: update-demo-nautilus-j9928 started at 2023-01-21 02:39:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container update-demo ready: true, restart count 0
Jan 21 02:41:23.443: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:23.443: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:23.443: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:23.443: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:23.443: INFO: deployment-74d7dd69db-wrgbz started at 2023-01-21 02:41:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container nginx ready: false, restart count 0
Jan 21 02:41:23.443: INFO: httpd started at 2023-01-21 02:40:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container httpd ready: true, restart count 0
Jan 21 02:41:23.443: INFO: execpodvvd84 started at 2023-01-21 02:41:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:23.443: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:23.443: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:23.443: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:23.443: INFO: nodeport-update-service-4svpk started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container nodeport-update-service ready: true, restart count 0
Jan 21 02:41:23.443: INFO: pod-ephm-test-configmap-htck started at 2023-01-21 02:41:06 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container test-container-subpath-configmap-htck ready: false, restart count 0
Jan 21 02:41:23.443: INFO: indexed-job-0-bwwzg started at 2023-01-21 02:41:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container c ready: false, restart count 0
Jan 21 02:41:23.443: INFO: indexed-job-1-x889v started at 2023-01-21 02:41:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.443: INFO: Container c ready: false, restart count 0
Jan 21 02:41:23.443: INFO: pod-projected-configmaps-005588a7-b13e-42da-bf41-0902d6942cb2 started at <nil> (0+0 container statuses recorded)
Jan 21 02:41:23.444: INFO: pod-0 started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.444: INFO: Container donothing ready: true, restart count 0
Jan 21 02:41:23.444: INFO: pod-ephm-test-secret-qkqc started at 2023-01-21 02:40:54 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.444: INFO: Container test-container-subpath-secret-qkqc ready: false, restart count 0
Jan 21 02:41:23.625: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:41:23.625: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:41:23.667: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 6842 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:41:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:40:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:41:23.668: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:41:23.718: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:41:23.790: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:41:23.790: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:41:23.790: INFO: pod-acad43b7-9ef6-4ace-9eeb-9eb21c95b600 started at <nil> (0+0 container statuses recorded)
Jan 21 02:41:23.790: INFO: csi-mockplugin-0 started at <nil> (0+0 container statuses recorded)
Jan 21 02:41:23.790: INFO: alpine-nnp-true-a2345f49-1044-407a-afd9-91eccba198a3 started at 2023-01-21 02:41:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container alpine-nnp-true-a2345f49-1044-407a-afd9-91eccba198a3 ready: false, restart count 0
Jan 21 02:41:23.790: INFO: deployment-74d7dd69db-qcdtj started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container nginx ready: false, restart count 0
Jan 21 02:41:23.790: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container coredns ready: true, restart count 0
Jan 21 02:41:23.790: INFO: pod-terminate-status-0-13 started at 2023-01-21 02:41:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container fail ready: false, restart count 0
Jan 21 02:41:23.790: INFO: liveness-c0362e42-cbf4-446a-a0a9-e4c308379179 started at 2023-01-21 02:39:14 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:23.790: INFO: hostexec-nodes-us-west1-a-vs1n-jllnz started at 2023-01-21 02:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:41:23.790: INFO: client-containers-604dfc33-6c47-406e-81b5-d3a12c727c36 started at <nil> (0+0 container statuses recorded)
Jan 21 02:41:23.790: INFO: nodeport-update-service-72dkh started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container nodeport-update-service ready: true, restart count 0
Jan 21 02:41:23.790: INFO: pod-c870c033-2a13-4a44-9343-640fab2030d9 started at 2023-01-21 02:41:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:41:23.790: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:41:23.790: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:41:23.790: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:41:23.790: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:41:23.790: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:41:23.790: INFO: csi-mockplugin-resizer-0 started at <nil> (0+0 container statuses recorded)
Jan 21 02:41:23.790: INFO: run-test-2 started at 2023-01-21 02:41:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container run-test-2 ready: false, restart count 0
Jan 21 02:41:23.790: INFO: condition-test-tm9vf started at 2023-01-21 02:41:20 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:41:23.790: INFO: Container httpd ready: false, restart count 0
Jan 21 02:41:23.790: INFO: hostexec-nodes-us-west1-a-vs1n-vqf4m started at <nil> (0+0 container statuses recorded)
Jan 21 02:41:24.338: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "webhook-1143" for this suite. �[38;5;243m01/21/23 02:41:24.338�[0m
�[1mSTEP:�[0m Destroying namespace "webhook-1143-markers" for this suite. �[38;5;243m01/21/23 02:41:24.484�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicationController\sshould\sserve\sa\sbasic\simage\son\seach\sreplica\swith\sa\spublic\simage\s\s\[Conformance\]$'
test/e2e/apps/rc.go:514
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc000335ef0, {0x75bd69b, 0x5}, {0xc000599b60, 0x2c})
test/e2e/apps/rc.go:514 +0x87e
k8s.io/kubernetes/test/e2e/apps.glob..func8.2()
test/e2e/apps/rc.go:68 +0x37
[BeforeEach] [sig-apps] ReplicationController
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:56:55.606�[0m
Jan 21 02:56:55.606: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename replication-controller �[38;5;243m01/21/23 02:56:55.607�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:56:55.787�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:56:55.89�[0m
[BeforeEach] [sig-apps] ReplicationController
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] ReplicationController
test/e2e/apps/rc.go:57
[It] should serve a basic image on each replica with a public image [Conformance]
test/e2e/apps/rc.go:67
�[1mSTEP:�[0m Creating replication controller my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853 �[38;5;243m01/21/23 02:56:55.977�[0m
Jan 21 02:56:56.088: INFO: Pod name my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853: Found 1 pods out of 1
Jan 21 02:56:56.088: INFO: Ensuring all pods for ReplicationController "my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853" are running
Jan 21 02:56:56.088: INFO: Waiting up to 5m0s for pod "my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq" in namespace "replication-controller-265" to be "running"
Jan 21 02:56:56.177: INFO: Pod "my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq": Phase="Pending", Reason="", readiness=false. Elapsed: 88.852477ms
Jan 21 02:56:58.275: INFO: Pod "my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq": Phase="Running", Reason="", readiness=true. Elapsed: 2.18672307s
Jan 21 02:56:58.275: INFO: Pod "my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq" satisfied condition "running"
Jan 21 02:56:58.275: INFO: Pod "my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq" is running (conditions: [])
Jan 21 02:56:58.275: INFO: Trying to dial the pod
Jan 21 02:57:33.404: INFO: Controller my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853: Failed to GET from replica 1 [my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq]: the server is currently unable to handle the request (get pods my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq)
pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}
Jan 21 02:58:08.414: INFO: Controller my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853: Failed to GET from replica 1 [my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq]: the server is currently unable to handle the request (get pods my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq)
pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}
Jan 21 02:58:43.403: INFO: Controller my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853: Failed to GET from replica 1 [my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq]: the server is currently unable to handle the request (get pods my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq)
pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}
Jan 21 02:59:18.402: INFO: Controller my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853: Failed to GET from replica 1 [my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq]: the server is currently unable to handle the request (get pods my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq)
pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}
Jan 21 02:59:48.533: INFO: Controller my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853: Failed to GET from replica 1 [my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq]: the server is currently unable to handle the request (get pods my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq)
pod status: v1.PodStatus{Phase:"Pending", Conditions:[]v1.PodCondition(nil), Message:"", Reason:"", NominatedNodeName:"", HostIP:"", PodIP:"", PodIPs:[]v1.PodIP(nil), StartTime:<nil>, InitContainerStatuses:[]v1.ContainerStatus(nil), ContainerStatuses:[]v1.ContainerStatus(nil), QOSClass:"BestEffort", EphemeralContainerStatuses:[]v1.ContainerStatus(nil)}
Jan 21 02:59:48.533: FAIL: Did not get expected responses within the timeout period of 120.00 seconds.
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc000335ef0, {0x75bd69b, 0x5}, {0xc000599b60, 0x2c})
test/e2e/apps/rc.go:514 +0x87e
k8s.io/kubernetes/test/e2e/apps.glob..func8.2()
test/e2e/apps/rc.go:68 +0x37
[AfterEach] [sig-apps] ReplicationController
test/e2e/framework/node/init/init.go:32
Jan 21 02:59:48.534: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] ReplicationController
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] ReplicationController
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:59:48.584�[0m
�[1mSTEP:�[0m Collecting events from namespace "replication-controller-265". �[38;5;243m01/21/23 02:59:48.585�[0m
�[1mSTEP:�[0m Found 5 events. �[38;5;243m01/21/23 02:59:48.627�[0m
Jan 21 02:59:48.627: INFO: At 2023-01-21 02:56:56 +0000 UTC - event for my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853: {replication-controller } SuccessfulCreate: Created pod: my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq
Jan 21 02:59:48.627: INFO: At 2023-01-21 02:56:56 +0000 UTC - event for my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq: {default-scheduler } Scheduled: Successfully assigned replication-controller-265/my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq to nodes-us-west1-a-3rdc
Jan 21 02:59:48.627: INFO: At 2023-01-21 02:56:56 +0000 UTC - event for my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:59:48.627: INFO: At 2023-01-21 02:56:57 +0000 UTC - event for my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq: {kubelet nodes-us-west1-a-3rdc} Created: Created container my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853
Jan 21 02:59:48.627: INFO: At 2023-01-21 02:56:57 +0000 UTC - event for my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq: {kubelet nodes-us-west1-a-3rdc} Started: Started container my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853
Jan 21 02:59:48.672: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:59:48.672: INFO: my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq nodes-us-west1-a-3rdc Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:56:56 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:56:57 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:56:57 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:56:56 +0000 UTC }]
Jan 21 02:59:48.672: INFO:
Jan 21 02:59:48.778: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:59:48.822: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 51204 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:56:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:59:48.823: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:59:48.870: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:59:48.950: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:59:48.950: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:59:48.950: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:59:48.950: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:59:48.950: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:59:48.950: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:59:48.950: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:59:48.950: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:59:48.950: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:59:48.950: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:59:48.950: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:59:48.950: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:59:48.950: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:59:48.950: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:59:48.950: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:59:49.213: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:59:49.213: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:59:49.257: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 55040 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:59:49.258: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:59:49.304: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:59:49.355: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:49.355: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:59:49.355: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:59:49.355: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:59:49.355: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:59:49.355: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:49.355: INFO: Container coredns ready: true, restart count 0
Jan 21 02:59:49.355: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:59:49.356: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:59:49.356: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:59:49.356: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:59:49.356: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:59:49.356: INFO: my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq started at 2023-01-21 02:56:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:49.356: INFO: Container my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853 ready: true, restart count 0
Jan 21 02:59:49.356: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:59:49.356: INFO: Container jessie-querier ready: true, restart count 1
Jan 21 02:59:49.356: INFO: Container querier ready: true, restart count 1
Jan 21 02:59:49.356: INFO: Container webserver ready: true, restart count 0
Jan 21 02:59:49.356: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:49.356: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:59:49.585: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:59:49.585: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:59:49.632: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 55226 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:59:49.632: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:59:49.678: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:59:49.739: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:59:49.739: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:59:49.739: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:59:49.739: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:49.739: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:59:49.739: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:59:49.739: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:59:49.739: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:59:49.739: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:59:49.739: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:59:49.979: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:59:49.979: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:59:50.023: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 55233 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:59:50.023: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:59:50.070: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:59:50.127: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:59:50.128: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:59:50.128: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:59:50.128: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:59:50.128: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:59:50.128: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:50.128: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:59:50.128: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:59:50.128: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:59:50.128: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:59:50.324: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:59:50.324: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:59:50.369: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 55215 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:59:50.369: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:59:50.417: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:59:50.474: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:59:50.474: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:59:50.474: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:59:50.474: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:50.474: INFO: Container coredns ready: true, restart count 0
Jan 21 02:59:50.474: INFO: busybox-026312bf-4cb8-4309-9aeb-d7e453e8410e started at 2023-01-21 02:56:24 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:50.474: INFO: Container busybox ready: true, restart count 0
Jan 21 02:59:50.474: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:59:50.474: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:59:50.474: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:59:50.474: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:59:50.474: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:59:50.474: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:59:50.474: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:59:50.707: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-apps] ReplicationController
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "replication-controller-265" for this suite. �[38;5;243m01/21/23 02:59:50.708�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sUpdate\sDemo\sshould\sscale\sa\sreplication\scontroller\s\s\[Conformance\]$'
test/e2e/kubectl/kubectl.go:2431
k8s.io/kubernetes/test/e2e/kubectl.validateController({0x8022ee8, 0xc0023ab520}, {0xc000e27050?, 0x0?}, 0x2, {0x75d3ea2, 0xb}, {0x75ec1bc, 0x10}, 0xc002d7cab0, ...)
test/e2e/kubectl/kubectl.go:2431 +0x49d
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.3()
test/e2e/kubectl/kubectl.go:357 +0x205
[BeforeEach] [sig-cli] Kubectl client
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:39:43.327�[0m
Jan 21 02:39:43.328: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/21/23 02:39:43.328�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:39:43.473�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:39:43.556�[0m
[BeforeEach] [sig-cli] Kubectl client
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
test/e2e/kubectl/kubectl.go:274
[BeforeEach] Update Demo
test/e2e/kubectl/kubectl.go:326
[It] should scale a replication controller [Conformance]
test/e2e/kubectl/kubectl.go:352
�[1mSTEP:�[0m creating a replication controller �[38;5;243m01/21/23 02:39:43.649�[0m
Jan 21 02:39:43.649: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 create -f -'
Jan 21 02:39:46.460: INFO: stderr: ""
Jan 21 02:39:46.460: INFO: stdout: "replicationcontroller/update-demo-nautilus created\n"
�[1mSTEP:�[0m waiting for all containers in name=update-demo pods to come up. �[38;5;243m01/21/23 02:39:46.46�[0m
Jan 21 02:39:46.460: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:39:46.755: INFO: stderr: ""
Jan 21 02:39:46.755: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:39:46.755: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:39:47.056: INFO: stderr: ""
Jan 21 02:39:47.056: INFO: stdout: ""
Jan 21 02:39:47.056: INFO: update-demo-nautilus-8lg8d is created but not running
Jan 21 02:39:52.056: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:39:52.319: INFO: stderr: ""
Jan 21 02:39:52.319: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:39:52.319: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:39:52.585: INFO: stderr: ""
Jan 21 02:39:52.585: INFO: stdout: ""
Jan 21 02:39:52.585: INFO: update-demo-nautilus-8lg8d is created but not running
Jan 21 02:39:57.585: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:39:57.838: INFO: stderr: ""
Jan 21 02:39:57.838: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:39:57.838: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:39:58.049: INFO: stderr: ""
Jan 21 02:39:58.049: INFO: stdout: "true"
Jan 21 02:39:58.049: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:39:58.257: INFO: stderr: ""
Jan 21 02:39:58.257: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:39:58.257: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:40:28.302: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:40:33.302: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:40:33.541: INFO: stderr: ""
Jan 21 02:40:33.541: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:40:33.541: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:40:33.749: INFO: stderr: ""
Jan 21 02:40:33.749: INFO: stdout: "true"
Jan 21 02:40:33.749: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:40:33.953: INFO: stderr: ""
Jan 21 02:40:33.953: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:40:33.953: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:41:03.999: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:41:09.000: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:41:09.252: INFO: stderr: ""
Jan 21 02:41:09.252: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:41:09.252: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:41:09.518: INFO: stderr: ""
Jan 21 02:41:09.518: INFO: stdout: "true"
Jan 21 02:41:09.518: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:41:10.054: INFO: stderr: ""
Jan 21 02:41:10.054: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:41:10.054: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:41:40.490: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:41:45.491: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:41:45.759: INFO: stderr: ""
Jan 21 02:41:45.759: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:41:45.760: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:41:45.977: INFO: stderr: ""
Jan 21 02:41:45.977: INFO: stdout: "true"
Jan 21 02:41:45.977: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:41:46.363: INFO: stderr: ""
Jan 21 02:41:46.363: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:41:46.363: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:42:16.520: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:42:21.521: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:42:21.805: INFO: stderr: ""
Jan 21 02:42:21.805: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:42:21.805: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:42:22.062: INFO: stderr: ""
Jan 21 02:42:22.062: INFO: stdout: "true"
Jan 21 02:42:22.062: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:42:22.287: INFO: stderr: ""
Jan 21 02:42:22.287: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:42:22.287: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:42:52.334: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:42:57.335: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:42:57.589: INFO: stderr: ""
Jan 21 02:42:57.589: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:42:57.589: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:42:57.800: INFO: stderr: ""
Jan 21 02:42:57.800: INFO: stdout: "true"
Jan 21 02:42:57.800: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:42:58.018: INFO: stderr: ""
Jan 21 02:42:58.018: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:42:58.018: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:43:28.068: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:43:33.069: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:43:33.397: INFO: stderr: ""
Jan 21 02:43:33.397: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:43:33.397: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:43:33.640: INFO: stderr: ""
Jan 21 02:43:33.640: INFO: stdout: "true"
Jan 21 02:43:33.640: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:43:33.891: INFO: stderr: ""
Jan 21 02:43:33.891: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:43:33.891: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:44:03.947: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:44:08.947: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:44:09.206: INFO: stderr: ""
Jan 21 02:44:09.206: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:44:09.206: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:44:09.431: INFO: stderr: ""
Jan 21 02:44:09.431: INFO: stdout: "true"
Jan 21 02:44:09.431: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:44:09.683: INFO: stderr: ""
Jan 21 02:44:09.683: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:44:09.683: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:44:39.743: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:44:44.743: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -o template --template={{range.items}}{{.metadata.name}} {{end}} -l name=update-demo'
Jan 21 02:44:45.003: INFO: stderr: ""
Jan 21 02:44:45.003: INFO: stdout: "update-demo-nautilus-8lg8d update-demo-nautilus-j9928 "
Jan 21 02:44:45.003: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "status" "containerStatuses")}}{{range .status.containerStatuses}}{{if (and (eq .name "update-demo") (exists . "state" "running"))}}true{{end}}{{end}}{{end}}'
Jan 21 02:44:45.231: INFO: stderr: ""
Jan 21 02:44:45.231: INFO: stdout: "true"
Jan 21 02:44:45.231: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods update-demo-nautilus-8lg8d -o template --template={{if (exists . "spec" "containers")}}{{range .spec.containers}}{{if eq .name "update-demo"}}{{.image}}{{end}}{{end}}{{end}}'
Jan 21 02:44:45.474: INFO: stderr: ""
Jan 21 02:44:45.474: INFO: stdout: "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:44:45.474: INFO: validating pod update-demo-nautilus-8lg8d
Jan 21 02:45:15.517: INFO: update-demo-nautilus-8lg8d is running right image but validator function failed: the server is currently unable to handle the request (get pods update-demo-nautilus-8lg8d)
Jan 21 02:45:20.518: FAIL: Timed out after 300 seconds waiting for name=update-demo pods to reach valid state
Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.validateController({0x8022ee8, 0xc0023ab520}, {0xc000e27050?, 0x0?}, 0x2, {0x75d3ea2, 0xb}, {0x75ec1bc, 0x10}, 0xc002d7cab0, ...)
test/e2e/kubectl/kubectl.go:2431 +0x49d
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.6.3()
test/e2e/kubectl/kubectl.go:357 +0x205
�[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/21/23 02:45:20.518�[0m
Jan 21 02:45:20.518: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 delete --grace-period=0 --force -f -'
Jan 21 02:45:20.815: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n"
Jan 21 02:45:20.815: INFO: stdout: "replicationcontroller \"update-demo-nautilus\" force deleted\n"
Jan 21 02:45:20.815: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get rc,svc -l name=update-demo --no-headers'
Jan 21 02:45:21.091: INFO: stderr: "No resources found in kubectl-7388 namespace.\n"
Jan 21 02:45:21.091: INFO: stdout: ""
Jan 21 02:45:21.091: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/369b63ae-9933-11ed-a697-56ea552f9d82/kubectl --server=https://34.145.25.143 --kubeconfig=/root/.kube/config --namespace=kubectl-7388 get pods -l name=update-demo -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}'
Jan 21 02:45:21.345: INFO: stderr: ""
Jan 21 02:45:21.345: INFO: stdout: ""
[AfterEach] [sig-cli] Kubectl client
test/e2e/framework/node/init/init.go:32
Jan 21 02:45:21.345: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:45:21.413�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-7388". �[38;5;243m01/21/23 02:45:21.413�[0m
�[1mSTEP:�[0m Found 14 events. �[38;5;243m01/21/23 02:45:21.457�[0m
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:46 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-8lg8d
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:46 +0000 UTC - event for update-demo-nautilus: {replication-controller } SuccessfulCreate: Created pod: update-demo-nautilus-j9928
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:46 +0000 UTC - event for update-demo-nautilus-8lg8d: {default-scheduler } Scheduled: Successfully assigned kubectl-7388/update-demo-nautilus-8lg8d to nodes-us-west1-a-3rdc
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:46 +0000 UTC - event for update-demo-nautilus-j9928: {default-scheduler } Scheduled: Successfully assigned kubectl-7388/update-demo-nautilus-j9928 to nodes-us-west1-a-m5ts
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:48 +0000 UTC - event for update-demo-nautilus-8lg8d: {kubelet nodes-us-west1-a-3rdc} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:49 +0000 UTC - event for update-demo-nautilus-j9928: {kubelet nodes-us-west1-a-m5ts} Pulling: Pulling image "registry.k8s.io/e2e-test-images/nautilus:1.7"
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:51 +0000 UTC - event for update-demo-nautilus-8lg8d: {kubelet nodes-us-west1-a-3rdc} Created: Created container update-demo
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:51 +0000 UTC - event for update-demo-nautilus-8lg8d: {kubelet nodes-us-west1-a-3rdc} Started: Started container update-demo
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:51 +0000 UTC - event for update-demo-nautilus-8lg8d: {kubelet nodes-us-west1-a-3rdc} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nautilus:1.7" in 3.546188366s (3.546194366s including waiting)
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:53 +0000 UTC - event for update-demo-nautilus-j9928: {kubelet nodes-us-west1-a-m5ts} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/nautilus:1.7" in 4.117155616s (4.117266467s including waiting)
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:53 +0000 UTC - event for update-demo-nautilus-j9928: {kubelet nodes-us-west1-a-m5ts} Created: Created container update-demo
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:39:53 +0000 UTC - event for update-demo-nautilus-j9928: {kubelet nodes-us-west1-a-m5ts} Started: Started container update-demo
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:45:20 +0000 UTC - event for update-demo-nautilus-8lg8d: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container update-demo
Jan 21 02:45:21.457: INFO: At 2023-01-21 02:45:20 +0000 UTC - event for update-demo-nautilus-j9928: {kubelet nodes-us-west1-a-m5ts} Killing: Stopping container update-demo
Jan 21 02:45:21.504: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:45:21.504: INFO: update-demo-nautilus-8lg8d nodes-us-west1-a-3rdc Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:46 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:52 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:52 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:46 +0000 UTC }]
Jan 21 02:45:21.504: INFO: update-demo-nautilus-j9928 nodes-us-west1-a-m5ts Running 30s [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:46 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:54 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:54 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:39:46 +0000 UTC }]
Jan 21 02:45:21.504: INFO:
Jan 21 02:45:21.661: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:45:21.727: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 7969 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:41:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:25 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:25 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:41:25 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:41:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:45:21.728: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:45:21.795: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:45:21.898: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:45:21.898: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:45:21.898: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:45:21.898: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:45:21.898: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:45:21.898: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:45:21.898: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:45:21.898: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:45:21.898: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:45:21.898: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:45:21.898: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:45:21.898: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:45:21.898: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:45:21.898: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:21.898: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:45:22.322: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:45:22.322: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:45:22.374: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 19407 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:45:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:12 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:12 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:12 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:45:12 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:45:22.375: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:45:22.429: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:45:22.510: INFO: netserver-0 started at 2023-01-21 02:44:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:22.510: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:45:22.510: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:45:22.510: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:45:22.510: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container coredns ready: true, restart count 0
Jan 21 02:45:22.510: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:45:22.510: INFO: netserver-0 started at 2023-01-21 02:44:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:22.510: INFO: up-down-2-wd8zt started at 2023-01-21 02:44:35 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container up-down-2 ready: true, restart count 0
Jan 21 02:45:22.510: INFO: dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37 started at 2023-01-21 02:44:24 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:45:22.510: INFO: Container querier ready: true, restart count 0
Jan 21 02:45:22.510: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:22.510: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:45:22.510: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:45:22.510: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:45:22.510: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:45:22.510: INFO: deployment-6c94ddcb9f-kpjmc started at 2023-01-21 02:43:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.510: INFO: Container nginx ready: false, restart count 0
Jan 21 02:45:22.788: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:45:22.788: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:45:22.837: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 19220 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:45:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 02:45:17 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:05 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:05 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:05 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:45:05 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-fdf23906-68d6-4c6b-adf0-6553c66522ce],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-fdf23906-68d6-4c6b-adf0-6553c66522ce,DevicePath:,},},Config:nil,},}
Jan 21 02:45:22.837: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:45:22.908: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:45:22.982: INFO: up-down-2-6d2gw started at 2023-01-21 02:44:35 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container up-down-2 ready: true, restart count 0
Jan 21 02:45:22.982: INFO: liveness-1b876b6c-4aa1-4cd3-9163-2a6da215b5f3 started at 2023-01-21 02:42:57 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:45:22.982: INFO: pod-configmaps-fd30f7e3-a7e7-44e7-8e90-86f10e59cabe started at 2023-01-21 02:45:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container env-test ready: false, restart count 0
Jan 21 02:45:22.982: INFO: hostexec-nodes-us-west1-a-kvqf-zdt4c started at 2023-01-21 02:45:13 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:45:22.982: INFO: agnhost-host-aliases4653819b-6f4f-456f-a239-5a825a5f0253 started at 2023-01-21 02:45:02 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:45:22.982: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:45:22.982: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:45:22.982: INFO: deployment-6c94ddcb9f-mqv9m started at 2023-01-21 02:43:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container nginx ready: false, restart count 0
Jan 21 02:45:22.982: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:45:22.982: INFO: deployment-74d7dd69db-cp5tj started at 2023-01-21 02:43:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container nginx ready: false, restart count 0
Jan 21 02:45:22.982: INFO: pod-configmaps-fd6c089b-70c2-4cf3-bc28-f01f80c32b74 started at 2023-01-21 02:45:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:45:22.982: INFO: netserver-1 started at 2023-01-21 02:44:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:22.982: INFO: pod-subpath-test-preprovisionedpv-qr48 started at 2023-01-21 02:44:53 +0000 UTC (1+2 container statuses recorded)
Jan 21 02:45:22.982: INFO: Init container test-init-subpath-preprovisionedpv-qr48 ready: true, restart count 0
Jan 21 02:45:22.982: INFO: Container test-container-subpath-preprovisionedpv-qr48 ready: false, restart count 0
Jan 21 02:45:22.982: INFO: Container test-container-volume-preprovisionedpv-qr48 ready: false, restart count 0
Jan 21 02:45:22.982: INFO: pvc-tester-94bqt started at 2023-01-21 02:45:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.982: INFO: Container write-pod ready: false, restart count 0
Jan 21 02:45:22.982: INFO: host-test-container-pod started at 2023-01-21 02:45:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:45:22.983: INFO: hostexec-nodes-us-west1-a-kvqf-8rpz8 started at 2023-01-21 02:44:29 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:45:22.983: INFO: startup-753263a6-970e-425a-be04-67285c55ba43 started at 2023-01-21 02:44:49 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Container busybox ready: false, restart count 0
Jan 21 02:45:22.983: INFO: netserver-1 started at 2023-01-21 02:44:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:22.983: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:45:22.983: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:45:22.983: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:45:22.983: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:45:22.983: INFO: up-down-1-sbqrb started at 2023-01-21 02:44:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Container up-down-1 ready: true, restart count 0
Jan 21 02:45:22.983: INFO: httpd started at 2023-01-21 02:44:50 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Container httpd ready: true, restart count 0
Jan 21 02:45:22.983: INFO: test-container-pod started at 2023-01-21 02:45:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:22.983: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:23.363: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:45:23.363: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:45:23.407: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 19146 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:45:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:15 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:15 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:15 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:45:15 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:45:23.407: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:45:23.454: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:45:23.513: INFO: pod-subpath-test-preprovisionedpv-zksk started at 2023-01-21 02:44:54 +0000 UTC (1+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Init container init-volume-preprovisionedpv-zksk ready: true, restart count 0
Jan 21 02:45:23.513: INFO: Container test-container-subpath-preprovisionedpv-zksk ready: true, restart count 0
Jan 21 02:45:23.513: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:45:23.513: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:45:23.513: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:45:23.513: INFO: hostexec-nodes-us-west1-a-m5ts-fvlv5 started at 2023-01-21 02:44:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:45:23.513: INFO: pod-45b4823e-d1d6-4937-b5c6-d31e46f1001c started at <nil> (0+0 container statuses recorded)
Jan 21 02:45:23.513: INFO: pfpod started at 2023-01-21 02:45:08 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container portforwardtester ready: true, restart count 0
Jan 21 02:45:23.513: INFO: Container readiness ready: true, restart count 0
Jan 21 02:45:23.513: INFO: explicit-root-uid started at 2023-01-21 02:45:10 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container explicit-root-uid ready: false, restart count 0
Jan 21 02:45:23.513: INFO: pod-jhnhs started at 2023-01-21 02:45:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container agnhost ready: false, restart count 0
Jan 21 02:45:23.513: INFO: deployment-6c94ddcb9f-tpbl6 started at 2023-01-21 02:43:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container nginx ready: false, restart count 0
Jan 21 02:45:23.513: INFO: up-down-2-8qtmf started at 2023-01-21 02:44:35 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container up-down-2 ready: true, restart count 0
Jan 21 02:45:23.513: INFO: busybox-scheduling-30bca6c9-546a-4aa2-a6fa-165866401c93 started at 2023-01-21 02:45:02 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container busybox-scheduling-30bca6c9-546a-4aa2-a6fa-165866401c93 ready: true, restart count 0
Jan 21 02:45:23.513: INFO: hostexec-nodes-us-west1-a-m5ts-m9ct6 started at 2023-01-21 02:45:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:45:23.513: INFO: pod-680c8571-1390-4ea5-8aa5-ece31672c2a4 started at 2023-01-21 02:45:09 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container write-pod ready: true, restart count 0
Jan 21 02:45:23.513: INFO: hostexec-nodes-us-west1-a-m5ts-rm89s started at 2023-01-21 02:45:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:45:23.513: INFO: hostexec-nodes-us-west1-a-m5ts-7ckcs started at 2023-01-21 02:45:08 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:45:23.513: INFO: pod-8f085db4-0f43-4d12-8d22-bdf781a2b8cb started at 2023-01-21 02:45:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container write-pod ready: false, restart count 0
Jan 21 02:45:23.513: INFO: update-demo-nautilus-j9928 started at 2023-01-21 02:39:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container update-demo ready: true, restart count 0
Jan 21 02:45:23.513: INFO: configmap-client started at <nil> (0+0 container statuses recorded)
Jan 21 02:45:23.513: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:45:23.513: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:45:23.513: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:45:23.513: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:45:23.513: INFO: up-down-1-6657s started at 2023-01-21 02:44:23 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container up-down-1 ready: true, restart count 0
Jan 21 02:45:23.513: INFO: netserver-2 started at 2023-01-21 02:44:44 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:23.513: INFO: netserver-2 started at 2023-01-21 02:44:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.513: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:23.750: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:45:23.750: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:45:23.794: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 19192 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-7695":"nodes-us-west1-a-vs1n","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:45:16 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:45:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:45:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:45:16 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-7695^7a9745df-9935-11ed-b6ab-4a9fac65960a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-7695^7a9745df-9935-11ed-b6ab-4a9fac65960a,DevicePath:,},},Config:nil,},}
Jan 21 02:45:23.794: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:45:23.841: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:45:23.902: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:45:23.902: INFO: netserver-3 started at 2023-01-21 02:44:47 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:23.902: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container coredns ready: true, restart count 0
Jan 21 02:45:23.902: INFO: success started at 2023-01-21 02:45:18 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container success ready: false, restart count 0
Jan 21 02:45:23.902: INFO: pod-secrets-a14c7b32-7f7c-44ed-aa02-d7a3000b2f13 started at 2023-01-21 02:45:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container secret-volume-test ready: false, restart count 0
Jan 21 02:45:23.902: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:44:06 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:45:23.902: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:45:23.902: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:45:23.902: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:45:23.902: INFO: inline-volume-tester-jd2jr started at 2023-01-21 02:44:09 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 21 02:45:23.902: INFO: pod-disruption-failure-ignore-0-dtvwk started at 2023-01-21 02:45:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container c ready: false, restart count 0
Jan 21 02:45:23.902: INFO: netserver-3 started at 2023-01-21 02:44:44 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:23.902: INFO: pod-disruption-failure-ignore-1-rbkhk started at 2023-01-21 02:45:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container c ready: false, restart count 0
Jan 21 02:45:23.902: INFO: test-container-pod started at 2023-01-21 02:45:14 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:45:23.902: INFO: Container webserver ready: true, restart count 0
Jan 21 02:45:24.282: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-cli] Kubectl client
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-7388" for this suite. �[38;5;243m01/21/23 02:45:24.282�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sprovide\s\/etc\/hosts\sentries\sfor\sthe\scluster\s\[Conformance\]$'
test/e2e/network/dns_common.go:455
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc005e36540?, 0x4?, 0x4?}, {0x75c48f4?, 0x7?}, 0xc005bd5680?, {0x8022ee8?, 0xc004163860?}, 0x0?, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000f6be00, 0xc005bd5680, {0xc005e36540, 0x4, 0x4})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.4()
test/e2e/network/dns.go:129 +0x4de
[BeforeEach] [sig-network] DNS
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:48:10.723�[0m
Jan 21 02:48:10.723: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/21/23 02:48:10.725�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:48:10.858�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:48:10.942�[0m
[BeforeEach] [sig-network] DNS
test/e2e/framework/metrics/init/init.go:31
[It] should provide /etc/hosts entries for the cluster [Conformance]
test/e2e/network/dns.go:117
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-7546.svc.cluster.local)" && echo OK > /results/wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/wheezy_hosts@dns-querier-1;sleep 1; done
�[38;5;243m01/21/23 02:48:11.031�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-7546.svc.cluster.local)" && echo OK > /results/jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/jessie_hosts@dns-querier-1;sleep 1; done
�[38;5;243m01/21/23 02:48:11.031�[0m
�[1mSTEP:�[0m creating a pod to probe /etc/hosts �[38;5;243m01/21/23 02:48:11.031�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/21/23 02:48:11.031�[0m
Jan 21 02:48:11.082: INFO: Waiting up to 15m0s for pod "dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e" in namespace "dns-7546" to be "running"
Jan 21 02:48:11.125: INFO: Pod "dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e": Phase="Pending", Reason="", readiness=false. Elapsed: 42.169642ms
Jan 21 02:48:13.189: INFO: Pod "dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e": Phase="Pending", Reason="", readiness=false. Elapsed: 2.106565789s
Jan 21 02:48:15.172: INFO: Pod "dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e": Phase="Pending", Reason="", readiness=false. Elapsed: 4.089352893s
Jan 21 02:48:17.171: INFO: Pod "dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e": Phase="Pending", Reason="", readiness=false. Elapsed: 6.088040499s
Jan 21 02:48:19.198: INFO: Pod "dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e": Phase="Running", Reason="", readiness=true. Elapsed: 8.115500538s
Jan 21 02:48:19.198: INFO: Pod "dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/21/23 02:48:19.198�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/21/23 02:48:19.256�[0m
Jan 21 02:48:49.306: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:49:19.354: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:49:49.409: INFO: Unable to read jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:50:19.489: INFO: Unable to read jessie_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:50:19.489: INFO: Lookups using dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e failed for: [wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local wheezy_hosts@dns-querier-1 jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local jessie_hosts@dns-querier-1]
Jan 21 02:50:54.556: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:51:24.623: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:51:55.614: INFO: Unable to read jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:52:25.683: INFO: Unable to read jessie_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:52:25.683: INFO: Lookups using dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e failed for: [wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local wheezy_hosts@dns-querier-1 jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local jessie_hosts@dns-querier-1]
Jan 21 02:52:59.537: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:53:29.587: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:53:59.646: INFO: Unable to read jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:54:29.696: INFO: Unable to read jessie_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:54:29.696: INFO: Lookups using dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e failed for: [wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local wheezy_hosts@dns-querier-1 jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local jessie_hosts@dns-querier-1]
Jan 21 02:55:04.554: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:55:34.599: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:56:04.649: INFO: Unable to read jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:56:34.700: INFO: Unable to read jessie_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:56:34.700: INFO: Lookups using dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e failed for: [wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local wheezy_hosts@dns-querier-1 jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local jessie_hosts@dns-querier-1]
Jan 21 02:57:09.534: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:57:39.578: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:58:09.621: INFO: Unable to read jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:58:39.664: INFO: Unable to read jessie_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:58:39.664: INFO: Lookups using dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e failed for: [wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local wheezy_hosts@dns-querier-1 jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local jessie_hosts@dns-querier-1]
Jan 21 02:59:14.533: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 02:59:44.577: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 03:00:14.620: INFO: Unable to read jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 03:00:44.664: INFO: Unable to read jessie_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 03:00:44.664: INFO: Lookups using dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e failed for: [wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local wheezy_hosts@dns-querier-1 jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local jessie_hosts@dns-querier-1]
Jan 21 03:01:14.708: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 03:01:44.750: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 03:02:14.793: INFO: Unable to read jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 03:02:44.837: INFO: Unable to read jessie_hosts@dns-querier-1 from pod dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: the server is currently unable to handle the request (get pods dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e)
Jan 21 03:02:44.837: INFO: Lookups using dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e failed for: [wheezy_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local wheezy_hosts@dns-querier-1 jessie_hosts@dns-querier-1.dns-test-service.dns-7546.svc.cluster.local jessie_hosts@dns-querier-1]
Jan 21 03:02:44.837: INFO: Unexpected error:
<*errors.errorString | 0xc000171a20>: {
s: "timed out waiting for the condition",
}
Jan 21 03:02:44.837: FAIL: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc005e36540?, 0x4?, 0x4?}, {0x75c48f4?, 0x7?}, 0xc005bd5680?, {0x8022ee8?, 0xc004163860?}, 0x0?, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1dc
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000f6be00, 0xc005bd5680, {0xc005e36540, 0x4, 0x4})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.4()
test/e2e/network/dns.go:129 +0x4de
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/21/23 03:02:44.837�[0m
[AfterEach] [sig-network] DNS
test/e2e/framework/node/init/init.go:32
Jan 21 03:02:44.897: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 03:02:44.95�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-7546". �[38;5;243m01/21/23 03:02:44.95�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/21/23 03:02:44.995�[0m
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:11 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {default-scheduler } Scheduled: Successfully assigned dns-7546/dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e to nodes-us-west1-a-3rdc
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Created: Created container webserver
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Started: Started container webserver
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Created: Created container querier
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Started: Started container querier
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" already present on machine
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Created: Created container jessie-querier
Jan 21 03:02:44.995: INFO: At 2023-01-21 02:48:13 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Started: Started container jessie-querier
Jan 21 03:02:44.995: INFO: At 2023-01-21 03:02:44 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container webserver
Jan 21 03:02:44.995: INFO: At 2023-01-21 03:02:44 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container jessie-querier
Jan 21 03:02:44.995: INFO: At 2023-01-21 03:02:44 +0000 UTC - event for dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container querier
Jan 21 03:02:45.037: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 03:02:45.037: INFO:
Jan 21 03:02:45.088: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 03:02:45.132: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 55763 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 03:01:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 03:01:49 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 03:01:49 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 03:01:49 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 03:01:49 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 03:02:45.133: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 03:02:45.180: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 03:02:45.260: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 03:02:45.260: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Init container install-cni ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Container calico-node ready: true, restart count 0
Jan 21 03:02:45.260: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 03:02:45.260: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 03:02:45.260: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container dns-controller ready: true, restart count 0
Jan 21 03:02:45.260: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 03:02:45.260: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container healthcheck ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 03:02:45.260: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 03:02:45.260: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 03:02:45.260: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 03:02:45.260: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 03:02:45.260: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 03:02:45.260: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container kops-controller ready: true, restart count 0
Jan 21 03:02:45.260: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.260: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 03:02:45.504: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 03:02:45.504: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 03:02:45.549: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 55040 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:01 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 03:02:45.550: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 03:02:45.596: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 03:02:45.654: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 03:02:45.654: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 03:02:45.654: INFO: Init container install-cni ready: true, restart count 0
Jan 21 03:02:45.654: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 03:02:45.654: INFO: Container calico-node ready: true, restart count 0
Jan 21 03:02:45.654: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.654: INFO: Container autoscaler ready: true, restart count 0
Jan 21 03:02:45.654: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.654: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 03:02:45.654: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 03:02:45.654: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 03:02:45.654: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 03:02:45.654: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:45.654: INFO: Container coredns ready: true, restart count 0
Jan 21 03:02:45.860: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 03:02:45.860: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 03:02:45.903: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 55226 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 03:02:45.904: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 03:02:45.950: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 03:02:46.009: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 03:02:46.009: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 03:02:46.009: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 03:02:46.009: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:46.009: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 03:02:46.009: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 03:02:46.009: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 03:02:46.009: INFO: Init container install-cni ready: true, restart count 0
Jan 21 03:02:46.009: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 03:02:46.009: INFO: Container calico-node ready: true, restart count 0
Jan 21 03:02:46.235: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 03:02:46.235: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 03:02:46.280: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 55233 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:33 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 03:02:46.280: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 03:02:46.326: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 03:02:46.379: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 03:02:46.379: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 03:02:46.379: INFO: Init container install-cni ready: true, restart count 0
Jan 21 03:02:46.379: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 03:02:46.379: INFO: Container calico-node ready: true, restart count 0
Jan 21 03:02:46.379: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:46.379: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 03:02:46.379: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 03:02:46.379: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 03:02:46.379: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 03:02:46.573: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 03:02:46.573: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 03:02:46.617: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 55215 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:59:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:59:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 03:02:46.617: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 03:02:46.662: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 03:02:46.724: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:46.724: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 03:02:46.724: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 03:02:46.724: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 03:02:46.724: INFO: Init container install-cni ready: true, restart count 0
Jan 21 03:02:46.724: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 03:02:46.724: INFO: Container calico-node ready: true, restart count 0
Jan 21 03:02:46.724: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 03:02:46.724: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 03:02:46.724: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 03:02:46.724: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 03:02:46.724: INFO: Container coredns ready: true, restart count 0
Jan 21 03:02:46.982: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-network] DNS
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "dns-7546" for this suite. �[38;5;243m01/21/23 03:02:46.982�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\sresolve\sDNS\sof\spartial\squalified\snames\sfor\sservices\s\[LinuxOnly\]\s\[Conformance\]$'
test/e2e/network/dns_common.go:472
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc0000b5800})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc00497a7b8?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc00497a848?, 0x262c967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc000b01180, 0x18, 0x28}, {0x75c48f4, 0x7}, 0xc004dea000, {0x8022ee8?, 0xc002b54340}, 0x0, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc0009f8e10, 0xc004dea000, {0xc000b01180, 0x18, 0x28})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.6()
test/e2e/network/dns.go:239 +0xc95
[BeforeEach] [sig-network] DNS
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:44:23.88�[0m
Jan 21 02:44:23.880: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/21/23 02:44:23.881�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:44:24.012�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:44:24.096�[0m
[BeforeEach] [sig-network] DNS
test/e2e/framework/metrics/init/init.go:31
[It] should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance]
test/e2e/network/dns.go:193
�[1mSTEP:�[0m Creating a test headless service �[38;5;243m01/21/23 02:44:24.178�[0m
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service;check="$$(dig +tcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-6753 A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service.dns-6753;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-6753 A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service.dns-6753;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-6753.svc A)" && test -n "$$check" && echo OK > /results/wheezy_udp@dns-test-service.dns-6753.svc;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-6753.svc A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@dns-test-service.dns-6753.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.dns-test-service.dns-6753.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.dns-test-service.dns-6753.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_udp@_http._tcp.test-service-2.dns-6753.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/wheezy_tcp@_http._tcp.test-service-2.dns-6753.svc;check="$$(dig +notcp +noall +answer +search 195.206.67.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.67.206.195_udp@PTR;check="$$(dig +tcp +noall +answer +search 195.206.67.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.67.206.195_tcp@PTR;sleep 1; done
�[38;5;243m01/21/23 02:44:24.289�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service;check="$$(dig +tcp +noall +answer +search dns-test-service A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-6753 A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service.dns-6753;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-6753 A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service.dns-6753;check="$$(dig +notcp +noall +answer +search dns-test-service.dns-6753.svc A)" && test -n "$$check" && echo OK > /results/jessie_udp@dns-test-service.dns-6753.svc;check="$$(dig +tcp +noall +answer +search dns-test-service.dns-6753.svc A)" && test -n "$$check" && echo OK > /results/jessie_tcp@dns-test-service.dns-6753.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.dns-test-service.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.dns-test-service.dns-6753.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.dns-test-service.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.dns-test-service.dns-6753.svc;check="$$(dig +notcp +noall +answer +search _http._tcp.test-service-2.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_udp@_http._tcp.test-service-2.dns-6753.svc;check="$$(dig +tcp +noall +answer +search _http._tcp.test-service-2.dns-6753.svc SRV)" && test -n "$$check" && echo OK > /results/jessie_tcp@_http._tcp.test-service-2.dns-6753.svc;check="$$(dig +notcp +noall +answer +search 195.206.67.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.67.206.195_udp@PTR;check="$$(dig +tcp +noall +answer +search 195.206.67.100.in-addr.arpa. PTR)" && test -n "$$check" && echo OK > /results/100.67.206.195_tcp@PTR;sleep 1; done
�[38;5;243m01/21/23 02:44:24.289�[0m
�[1mSTEP:�[0m creating a pod to probe DNS �[38;5;243m01/21/23 02:44:24.289�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/21/23 02:44:24.289�[0m
Jan 21 02:44:24.351: INFO: Waiting up to 15m0s for pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37" in namespace "dns-6753" to be "running"
Jan 21 02:44:24.415: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37": Phase="Pending", Reason="", readiness=false. Elapsed: 63.815163ms
Jan 21 02:44:26.461: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37": Phase="Pending", Reason="", readiness=false. Elapsed: 2.11037764s
Jan 21 02:44:28.460: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37": Phase="Pending", Reason="", readiness=false. Elapsed: 4.108480372s
Jan 21 02:44:30.466: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37": Phase="Pending", Reason="", readiness=false. Elapsed: 6.11479558s
Jan 21 02:44:32.469: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37": Phase="Pending", Reason="", readiness=false. Elapsed: 8.117445496s
Jan 21 02:44:34.464: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37": Phase="Pending", Reason="", readiness=false. Elapsed: 10.112780005s
Jan 21 02:44:36.459: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37": Phase="Running", Reason="", readiness=true. Elapsed: 12.107962858s
Jan 21 02:44:36.459: INFO: Pod "dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/21/23 02:44:36.459�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/21/23 02:44:36.514�[0m
Jan 21 02:45:06.560: INFO: Unable to read wheezy_udp@dns-test-service from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:45:36.624: INFO: Unable to read wheezy_tcp@dns-test-service from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:46:06.667: INFO: Unable to read wheezy_udp@dns-test-service.dns-6753 from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:46:36.712: INFO: Unable to read wheezy_tcp@dns-test-service.dns-6753 from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:47:06.756: INFO: Unable to read wheezy_udp@dns-test-service.dns-6753.svc from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:47:36.830: INFO: Unable to read wheezy_tcp@dns-test-service.dns-6753.svc from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:48:06.874: INFO: Unable to read wheezy_udp@_http._tcp.dns-test-service.dns-6753.svc from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:48:36.929: INFO: Unable to read wheezy_tcp@_http._tcp.dns-test-service.dns-6753.svc from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:49:06.974: INFO: Unable to read wheezy_udp@_http._tcp.test-service-2.dns-6753.svc from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: the server is currently unable to handle the request (get pods dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37)
Jan 21 02:49:36.516: FAIL: Unable to read wheezy_tcp@_http._tcp.test-service-2.dns-6753.svc from pod dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: Get "https://34.145.25.143/api/v1/namespaces/dns-6753/pods/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37/proxy/results/wheezy_tcp@_http._tcp.test-service-2.dns-6753.svc": context deadline exceeded
Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc0000b5800})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc00497a7b8?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc00497a848?, 0x262c967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc000b01180, 0x18, 0x28}, {0x75c48f4, 0x7}, 0xc004dea000, {0x8022ee8?, 0xc002b54340}, 0x0, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc0009f8e10, 0xc004dea000, {0xc000b01180, 0x18, 0x28})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.6()
test/e2e/network/dns.go:239 +0xc95
E0121 02:49:36.516656 6885 runtime.go:79] Observed a panic: types.GinkgoError{Heading:"Your Test Panicked", Message:"When you, or your assertion library, calls Ginkgo's Fail(),\nGinkgo panics to prevent subsequent assertions from running.\n\nNormally Ginkgo rescues this panic so you shouldn't see it.\n\nHowever, if you make an assertion in a goroutine, Ginkgo can't capture the panic.\nTo circumvent this, you should call\n\n\tdefer GinkgoRecover()\n\nat the top of the goroutine that caused this panic.\n\nAlternatively, you may have made an assertion outside of a Ginkgo\nleaf node (e.g. in a container node or some out-of-band function) - please move your assertion to\nan appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).", DocLink:"mental-model-how-ginkgo-handles-failure", CodeLocation:types.CodeLocation{FileName:"test/e2e/network/dns_common.go", LineNumber:472, FullStackTrace:"k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()\n\ttest/e2e/network/dns_common.go:472 +0x845\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc0000b5800})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc00497a7b8?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc00497a848?, 0x262c967?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50\nk8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc000b01180, 0x18, 0x28}, {0x75c48f4, 0x7}, 0xc004dea000, {0x8022ee8?, 0xc002b54340}, 0x0, {0x0, ...})\n\ttest/e2e/network/dns_common.go:455 +0x1c5\nk8s.io/kubernetes/test/e2e/network.assertFilesExist(...)\n\ttest/e2e/network/dns_common.go:449\nk8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc0009f8e10, 0xc004dea000, {0xc000b01180, 0x18, 0x28})\n\ttest/e2e/network/dns_common.go:512 +0x452\nk8s.io/kubernetes/test/e2e/network.glob..func2.6()\n\ttest/e2e/network/dns.go:239 +0xc95", CustomMessage:""}} (�[1m�[38;5;9mYour Test Panicked�[0m
�[38;5;243mtest/e2e/network/dns_common.go:472�[0m
When you, or your assertion library, calls Ginkgo's Fail(),
Ginkgo panics to prevent subsequent assertions from running.
Normally Ginkgo rescues this panic so you shouldn't see it.
However, if you make an assertion in a goroutine, Ginkgo can't capture the
panic.
To circumvent this, you should call
defer GinkgoRecover()
at the top of the goroutine that caused this panic.
Alternatively, you may have made an assertion outside of a Ginkgo
leaf node (e.g. in a container node or some out-of-band function) - please
move your assertion to
an appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).
�[1mLearn more at:�[0m
�[38;5;14m�[4mhttp://onsi.github.io/ginkgo/#mental-model-how-ginkgo-handles-failure�[0m
)
goroutine 2330 [running]:
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x70efe60?, 0xc000b3c5b0})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0000c62d0?})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75
panic({0x70efe60, 0xc000b3c5b0})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2.Fail({0xc0058e4840, 0x15b}, {0xc00497a370?, 0x75b9afa?, 0xc00497a398?})
vendor/github.com/onsi/ginkgo/v2/core_dsl.go:352 +0x225
k8s.io/kubernetes/test/e2e/framework.Failf({0x767bfc2?, 0x2d?}, {0xc00497a5c0?, 0x0?, 0x0?})
test/e2e/framework/log.go:49 +0x12c
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc0000b5800})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc00497a7b8?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc00497a848?, 0x262c967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc000b01180, 0x18, 0x28}, {0x75c48f4, 0x7}, 0xc004dea000, {0x8022ee8?, 0xc002b54340}, 0x0, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc0009f8e10, 0xc004dea000, {0xc000b01180, 0x18, 0x28})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.6()
test/e2e/network/dns.go:239 +0xc95
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc004ab0ab0, 0xc00067fb60})
vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 +0x1b
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 +0x98
created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 +0xe3d
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/21/23 02:49:36.516�[0m
�[1mSTEP:�[0m deleting the test service �[38;5;243m01/21/23 02:49:36.613�[0m
�[1mSTEP:�[0m deleting the test headless service �[38;5;243m01/21/23 02:49:36.823�[0m
[AfterEach] [sig-network] DNS
test/e2e/framework/node/init/init.go:32
Jan 21 02:49:37.055: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:49:37.12�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-6753". �[38;5;243m01/21/23 02:49:37.12�[0m
�[1mSTEP:�[0m Found 14 events. �[38;5;243m01/21/23 02:49:37.187�[0m
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:24 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {default-scheduler } Scheduled: Successfully assigned dns-6753/dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37 to nodes-us-west1-a-3rdc
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:25 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:26 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Created: Created container webserver
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:26 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Started: Started container webserver
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:26 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:26 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Created: Created container querier
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:26 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Started: Started container querier
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:26 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Pulling: Pulling image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7"
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:33 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" in 7.509133766s (7.509169575s including waiting)
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:33 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Created: Created container jessie-querier
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:44:33 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Started: Started container jessie-querier
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:49:36 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container webserver
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:49:36 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container jessie-querier
Jan 21 02:49:37.187: INFO: At 2023-01-21 02:49:36 +0000 UTC - event for dns-test-a4a0c3fc-b376-44f1-8120-db66f741ef37: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container querier
Jan 21 02:49:37.249: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:49:37.249: INFO:
Jan 21 02:49:37.306: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:49:37.378: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 22571 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:46:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:49:37.379: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:49:37.442: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:49:37.570: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:49:37.570: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:49:37.570: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:49:37.570: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:49:37.570: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:49:37.570: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:49:37.570: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:49:37.570: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:49:37.570: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:49:37.570: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:49:37.570: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:49:37.570: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:49:37.570: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:49:37.570: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:49:37.570: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:49:38.010: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:49:38.010: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:49:38.092: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 25729 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:47:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:47:26 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:47:26 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:47:26 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:47:26 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:49:38.093: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:49:38.158: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:49:38.242: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:49:38.242: INFO: hostexec-nodes-us-west1-a-3rdc-7nv6m started at 2023-01-21 02:49:34 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:49:38.242: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:49:38.242: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:49:38.242: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:49:38.242: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container coredns ready: true, restart count 0
Jan 21 02:49:38.242: INFO: netserver-0 started at 2023-01-21 02:49:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container webserver ready: true, restart count 0
Jan 21 02:49:38.242: INFO: ss2-1 started at 2023-01-21 02:49:01 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container webserver ready: false, restart count 0
Jan 21 02:49:38.242: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:49:38.242: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:49:38.242: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:49:38.242: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:49:38.242: INFO: webserver-pod started at 2023-01-21 02:46:09 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container agnhost ready: false, restart count 0
Jan 21 02:49:38.242: INFO: service-headless-toggled-qp7jj started at 2023-01-21 02:48:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container service-headless-toggled ready: true, restart count 0
Jan 21 02:49:38.242: INFO: execpodqqxc8 started at 2023-01-21 02:49:34 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:49:38.242: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:49:38.242: INFO: Container querier ready: true, restart count 0
Jan 21 02:49:38.242: INFO: Container webserver ready: true, restart count 0
Jan 21 02:49:38.242: INFO: externalsvc-tqx57 started at 2023-01-21 02:49:30 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container externalsvc ready: true, restart count 0
Jan 21 02:49:38.242: INFO: agnhost started at 2023-01-21 02:48:25 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container agnhost ready: true, restart count 0
Jan 21 02:49:38.242: INFO: service-headless-j9v7v started at 2023-01-21 02:48:34 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:38.242: INFO: Container service-headless ready: true, restart count 0
Jan 21 02:49:38.585: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:49:38.585: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:49:38.638: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 30555 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-5751":"nodes-us-west1-a-kvqf","csi-hostpath-volume-expand-1342":"nodes-us-west1-a-kvqf","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:49:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:49:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:49:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:49:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:49:13 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-5751^2a82f608-9936-11ed-9fe1-12a47e30da03],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-5751^2a82f608-9936-11ed-9fe1-12a47e30da03,DevicePath:,},},Config:nil,},}
Jan 21 02:49:38.639: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:49:38.774: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:49:39.204: INFO: concurrent-27904488-648rn started at 2023-01-21 02:48:00 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container c ready: false, restart count 0
Jan 21 02:49:39.204: INFO: deployment-shared-unset-7cf876c5d4-6q4bv started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container nginx ready: false, restart count 0
Jan 21 02:49:39.204: INFO: pod-configmaps-82005b78-76fc-48e8-8231-8c4d01bd93d2 started at 2023-01-21 02:49:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container configmap-volume-binary-test ready: false, restart count 0
Jan 21 02:49:39.204: INFO: pod-should-be-evicted0edefbb0-804b-430c-9eb6-1ecbe19ab6f2 started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container bar ready: true, restart count 0
Jan 21 02:49:39.204: INFO: pod-subpath-test-dynamicpv-s2vp started at 2023-01-21 02:49:04 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container test-container-subpath-dynamicpv-s2vp ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container test-container-volume-dynamicpv-s2vp ready: true, restart count 0
Jan 21 02:49:39.204: INFO: test-ss-0 started at 2023-01-21 02:49:08 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container test-ss ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container webserver ready: false, restart count 0
Jan 21 02:49:39.204: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:49:39.204: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:49:27 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container csi-attacher ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container csi-provisioner ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container csi-resizer ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container hostpath ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container liveness-probe ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 21 02:49:39.204: INFO: pod-subpath-test-preprovisionedpv-kzf5 started at 2023-01-21 02:49:23 +0000 UTC (2+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Init container init-volume-preprovisionedpv-kzf5 ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Init container test-init-volume-preprovisionedpv-kzf5 ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container test-container-subpath-preprovisionedpv-kzf5 ready: true, restart count 0
Jan 21 02:49:39.204: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:49:39.204: INFO: service-headless-toggled-c9q2b started at 2023-01-21 02:48:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container service-headless-toggled ready: true, restart count 0
Jan 21 02:49:39.204: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:48:57 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:49:39.204: INFO: service-headless-kxrnv started at 2023-01-21 02:48:34 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container service-headless ready: true, restart count 0
Jan 21 02:49:39.204: INFO: hostexec-nodes-us-west1-a-kvqf-wjsn5 started at 2023-01-21 02:49:03 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:49:39.204: INFO: netserver-1 started at 2023-01-21 02:49:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container webserver ready: false, restart count 0
Jan 21 02:49:39.204: INFO: test-pod-0d60b10a-8161-41bd-8a4e-5303b33ee493 started at 2023-01-21 02:49:18 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container agnhost-container ready: false, restart count 0
Jan 21 02:49:39.204: INFO: pod-subpath-test-inlinevolume-fqbx started at 2023-01-21 02:49:34 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:39.204: INFO: Container test-container-subpath-inlinevolume-fqbx ready: false, restart count 0
Jan 21 02:49:39.204: INFO: Container test-container-volume-inlinevolume-fqbx ready: false, restart count 0
Jan 21 02:49:39.204: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:49:39.204: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:49:39.204: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:49:41.008: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:49:41.008: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:49:41.057: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 28189 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:49:41.057: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:49:41.171: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:49:41.234: INFO: deployment-shared-unset-7cf876c5d4-2qhvw started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container nginx ready: false, restart count 0
Jan 21 02:49:41.234: INFO: netserver-2 started at 2023-01-21 02:49:16 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container webserver ready: true, restart count 0
Jan 21 02:49:41.234: INFO: pod-0842df16-4faf-4d88-954b-7d4c1e19d86e started at 2023-01-21 02:49:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container write-pod ready: false, restart count 0
Jan 21 02:49:41.234: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:49:41.234: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:49:41.234: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:49:41.234: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:49:41.234: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:49:41.234: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:49:41.234: INFO: ss2-2 started at 2023-01-21 02:48:52 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container webserver ready: true, restart count 0
Jan 21 02:49:41.234: INFO: externalsvc-2fpdq started at 2023-01-21 02:49:30 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container externalsvc ready: true, restart count 0
Jan 21 02:49:41.234: INFO: downwardapi-volume-f3936387-9d65-4da0-ac1a-d2f5a5a3d3c0 started at 2023-01-21 02:49:36 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container client-container ready: false, restart count 0
Jan 21 02:49:41.234: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:49:41.234: INFO: service-headless-toggled-nd2v2 started at 2023-01-21 02:48:43 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container service-headless-toggled ready: true, restart count 0
Jan 21 02:49:41.234: INFO: test-grpc-8df3911d-2903-4bb9-8802-2afe4515d92a started at 2023-01-21 02:48:36 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container etcd ready: true, restart count 0
Jan 21 02:49:41.234: INFO: sysctl-34a31b86-a017-4188-a40c-93a4ba7afcac started at 2023-01-21 02:49:34 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container test-container ready: false, restart count 0
Jan 21 02:49:41.234: INFO: service-headless-vqlch started at 2023-01-21 02:48:34 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container service-headless ready: true, restart count 0
Jan 21 02:49:41.234: INFO: dns-test-d83ac60b-0837-4f2a-9312-de6f7d278a0e started at 2023-01-21 02:49:39 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container jessie-querier ready: false, restart count 0
Jan 21 02:49:41.234: INFO: Container querier ready: false, restart count 0
Jan 21 02:49:41.234: INFO: Container webserver ready: false, restart count 0
Jan 21 02:49:41.234: INFO: hostexec-nodes-us-west1-a-m5ts-x9k4x started at 2023-01-21 02:49:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container agnhost-container ready: true, restart count 0
Jan 21 02:49:41.234: INFO: pod-configmaps-6bffb42b-68fe-4f90-90a8-f0c7a99f0f68 started at 2023-01-21 02:48:50 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:49:41.234: INFO: Container createcm-volume-test ready: true, restart count 0
Jan 21 02:49:41.234: INFO: Container delcm-volume-test ready: true, restart count 0
Jan 21 02:49:41.234: INFO: Container updcm-volume-test ready: true, restart count 0
Jan 21 02:49:42.074: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:49:42.074: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:49:42.118: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 30435 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5371":"nodes-us-west1-a-vs1n","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:49:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:49:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:49:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:49:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:49:32 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:49:42.118: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:49:42.174: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:49:42.249: INFO: busybox-2311429e-d0fc-490f-aeed-dd812771e0cb started at 2023-01-21 02:49:42 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container busybox ready: false, restart count 0
Jan 21 02:49:42.249: INFO: pod-disruption-failure-ignore-2-44hvv started at 2023-01-21 02:48:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container c ready: false, restart count 0
Jan 21 02:49:42.249: INFO: pod-disruption-failure-ignore-1-mmfng started at 2023-01-21 02:48:22 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container c ready: false, restart count 0
Jan 21 02:49:42.249: INFO: pod-disruption-failure-ignore-1-mcjk4 started at 2023-01-21 02:48:29 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container c ready: false, restart count 0
Jan 21 02:49:42.249: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:49:42.249: INFO: pod-disruption-failure-ignore-0-66mrn started at 2023-01-21 02:49:04 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container c ready: false, restart count 0
Jan 21 02:49:42.249: INFO: busybox-79b50771-5197-4b49-ab04-1c6cd45c6be8 started at 2023-01-21 02:49:26 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container busybox ready: false, restart count 0
Jan 21 02:49:42.249: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container coredns ready: true, restart count 0
Jan 21 02:49:42.249: INFO: pod-disruption-failure-ignore-3-j5rwj started at 2023-01-21 02:48:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container c ready: false, restart count 0
Jan 21 02:49:42.249: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:48:26 +0000 UTC (0+7 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container hostpath ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container liveness-probe ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 21 02:49:42.249: INFO: netserver-3 started at 2023-01-21 02:49:17 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container webserver ready: true, restart count 0
Jan 21 02:49:42.249: INFO: pod-1 started at 2023-01-21 02:49:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container donothing ready: false, restart count 0
Jan 21 02:49:42.249: INFO: ss2-0 started at 2023-01-21 02:49:12 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container webserver ready: true, restart count 0
Jan 21 02:49:42.249: INFO: test-container-pod started at 2023-01-21 02:49:41 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container webserver ready: false, restart count 0
Jan 21 02:49:42.249: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:49:42.249: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:49:42.249: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:49:42.249: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:49:42.799: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-network] DNS
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "dns-6753" for this suite. �[38;5;243m01/21/23 02:49:42.799�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\swork\swith\sthe\spod\scontaining\smore\sthan\s6\sDNS\ssearch\spaths\sand\slonger\sthan\s256\ssearch\slist\scharacters$'
test/e2e/network/dns_common.go:472
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc003e80000})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc0022c07b8?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc0022c0848?, 0x262c967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc001c80000, 0xc, 0x10}, {0x75c48f4, 0x7}, 0xc003860000, {0x8022ee8?, 0xc004e10680}, 0x0, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000f87e00, 0xc003860000, {0xc001c80000, 0xc, 0x10})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.12()
test/e2e/network/dns.go:613 +0xb92
[BeforeEach] [sig-network] DNS
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:53:12.657�[0m
Jan 21 02:53:12.657: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/21/23 02:53:12.658�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:53:12.801�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:53:12.883�[0m
[BeforeEach] [sig-network] DNS
test/e2e/framework/metrics/init/init.go:31
[It] should work with the pod containing more than 6 DNS search paths and longer than 256 search list characters
test/e2e/network/dns.go:572
�[1mSTEP:�[0m Getting the kube-dns IP �[38;5;243m01/21/23 02:53:12.965�[0m
�[1mSTEP:�[0m Running these commands on wheezy: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/wheezy_udp@kubernetes.default;check="$$(dig +tcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@kubernetes.default;check="$$(dig +notcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/wheezy_udp@kubernetes.default.svc;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/wheezy_tcp@kubernetes.default.svc;test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-712.svc.cluster.local)" && echo OK > /results/wheezy_hosts@dns-querier-1.dns-test-service.dns-712.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/wheezy_hosts@dns-querier-1;sleep 1; done
�[38;5;243m01/21/23 02:53:13.007�[0m
�[1mSTEP:�[0m Running these commands on jessie: for i in `seq 1 600`; do check="$$(dig +notcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/jessie_udp@kubernetes.default;check="$$(dig +tcp +noall +answer +search kubernetes.default A)" && test -n "$$check" && echo OK > /results/jessie_tcp@kubernetes.default;check="$$(dig +notcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/jessie_udp@kubernetes.default.svc;check="$$(dig +tcp +noall +answer +search kubernetes.default.svc A)" && test -n "$$check" && echo OK > /results/jessie_tcp@kubernetes.default.svc;test -n "$$(getent hosts dns-querier-1.dns-test-service.dns-712.svc.cluster.local)" && echo OK > /results/jessie_hosts@dns-querier-1.dns-test-service.dns-712.svc.cluster.local;test -n "$$(getent hosts dns-querier-1)" && echo OK > /results/jessie_hosts@dns-querier-1;sleep 1; done
�[38;5;243m01/21/23 02:53:13.008�[0m
�[1mSTEP:�[0m Creating a pod with expanded DNS configuration to probe DNS �[38;5;243m01/21/23 02:53:13.008�[0m
�[1mSTEP:�[0m submitting the pod to kubernetes �[38;5;243m01/21/23 02:53:13.008�[0m
Jan 21 02:53:13.063: INFO: Waiting up to 15m0s for pod "dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8" in namespace "dns-712" to be "running"
Jan 21 02:53:13.107: INFO: Pod "dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8": Phase="Pending", Reason="", readiness=false. Elapsed: 43.830049ms
Jan 21 02:53:15.157: INFO: Pod "dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8": Phase="Running", Reason="", readiness=true. Elapsed: 2.09417552s
Jan 21 02:53:15.157: INFO: Pod "dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8" satisfied condition "running"
�[1mSTEP:�[0m retrieving the pod �[38;5;243m01/21/23 02:53:15.157�[0m
�[1mSTEP:�[0m looking for the results for each expected name from probers �[38;5;243m01/21/23 02:53:15.206�[0m
Jan 21 02:53:45.257: INFO: Unable to read wheezy_udp@kubernetes.default from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:54:15.345: INFO: Unable to read wheezy_tcp@kubernetes.default from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:54:45.411: INFO: Unable to read wheezy_udp@kubernetes.default.svc from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:55:15.463: INFO: Unable to read wheezy_tcp@kubernetes.default.svc from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:55:45.517: INFO: Unable to read wheezy_hosts@dns-querier-1.dns-test-service.dns-712.svc.cluster.local from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:56:15.561: INFO: Unable to read wheezy_hosts@dns-querier-1 from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:56:45.604: INFO: Unable to read jessie_udp@kubernetes.default from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:57:15.685: INFO: Unable to read jessie_tcp@kubernetes.default from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:57:45.743: INFO: Unable to read jessie_udp@kubernetes.default.svc from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: the server is currently unable to handle the request (get pods dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8)
Jan 21 02:58:15.206: FAIL: Unable to read jessie_tcp@kubernetes.default.svc from pod dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: Get "https://34.145.25.143/api/v1/namespaces/dns-712/pods/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8/proxy/results/jessie_tcp@kubernetes.default.svc": context deadline exceeded
Full Stack Trace
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc003e80000})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc0022c07b8?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc0022c0848?, 0x262c967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc001c80000, 0xc, 0x10}, {0x75c48f4, 0x7}, 0xc003860000, {0x8022ee8?, 0xc004e10680}, 0x0, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000f87e00, 0xc003860000, {0xc001c80000, 0xc, 0x10})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.12()
test/e2e/network/dns.go:613 +0xb92
E0121 02:58:15.207164 6893 runtime.go:79] Observed a panic: types.GinkgoError{Heading:"Your Test Panicked", Message:"When you, or your assertion library, calls Ginkgo's Fail(),\nGinkgo panics to prevent subsequent assertions from running.\n\nNormally Ginkgo rescues this panic so you shouldn't see it.\n\nHowever, if you make an assertion in a goroutine, Ginkgo can't capture the panic.\nTo circumvent this, you should call\n\n\tdefer GinkgoRecover()\n\nat the top of the goroutine that caused this panic.\n\nAlternatively, you may have made an assertion outside of a Ginkgo\nleaf node (e.g. in a container node or some out-of-band function) - please move your assertion to\nan appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).", DocLink:"mental-model-how-ginkgo-handles-failure", CodeLocation:types.CodeLocation{FileName:"test/e2e/network/dns_common.go", LineNumber:472, FullStackTrace:"k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()\n\ttest/e2e/network/dns_common.go:472 +0x845\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc003e80000})\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc0022c07b8?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc0022c0848?, 0x262c967?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a\nk8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)\n\tvendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50\nk8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc001c80000, 0xc, 0x10}, {0x75c48f4, 0x7}, 0xc003860000, {0x8022ee8?, 0xc004e10680}, 0x0, {0x0, ...})\n\ttest/e2e/network/dns_common.go:455 +0x1c5\nk8s.io/kubernetes/test/e2e/network.assertFilesExist(...)\n\ttest/e2e/network/dns_common.go:449\nk8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000f87e00, 0xc003860000, {0xc001c80000, 0xc, 0x10})\n\ttest/e2e/network/dns_common.go:512 +0x452\nk8s.io/kubernetes/test/e2e/network.glob..func2.12()\n\ttest/e2e/network/dns.go:613 +0xb92", CustomMessage:""}} (�[1m�[38;5;9mYour Test Panicked�[0m
�[38;5;243mtest/e2e/network/dns_common.go:472�[0m
When you, or your assertion library, calls Ginkgo's Fail(),
Ginkgo panics to prevent subsequent assertions from running.
Normally Ginkgo rescues this panic so you shouldn't see it.
However, if you make an assertion in a goroutine, Ginkgo can't capture the
panic.
To circumvent this, you should call
defer GinkgoRecover()
at the top of the goroutine that caused this panic.
Alternatively, you may have made an assertion outside of a Ginkgo
leaf node (e.g. in a container node or some out-of-band function) - please
move your assertion to
an appropriate Ginkgo node (e.g. a BeforeSuite, BeforeEach, It, etc...).
�[1mLearn more at:�[0m
�[38;5;14m�[4mhttp://onsi.github.io/ginkgo/#mental-model-how-ginkgo-handles-failure�[0m
)
goroutine 4522 [running]:
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.logPanic({0x70efe60?, 0xc0002584d0})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:75 +0x99
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0000c62d0?})
vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:49 +0x75
panic({0x70efe60, 0xc0002584d0})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2.Fail({0xc002342280, 0x139}, {0xc0022c0370?, 0x75b9afa?, 0xc0022c0398?})
vendor/github.com/onsi/ginkgo/v2/core_dsl.go:352 +0x225
k8s.io/kubernetes/test/e2e/framework.Failf({0x767bfc2?, 0x2d?}, {0xc0022c05c0?, 0x0?, 0x0?})
test/e2e/framework/log.go:49 +0x12c
k8s.io/kubernetes/test/e2e/network.assertFilesContain.func1()
test/e2e/network/dns_common.go:472 +0x845
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.ConditionFunc.WithContext.func1({0x18, 0xc003e80000})
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:222 +0x1b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x7fe5ba8?, 0xc000082048?}, 0xc0022c07b8?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:235 +0x57
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.poll({0x7fe5ba8, 0xc000082048}, 0xf8?, 0x2fdc465?, 0x60?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:582 +0x38
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediateWithContext({0x7fe5ba8, 0xc000082048}, 0x7f94698?, 0xc0022c0848?, 0x262c967?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:528 +0x4a
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x1e?, 0x1ff?, 0x0?)
vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:514 +0x50
k8s.io/kubernetes/test/e2e/network.assertFilesContain({0xc001c80000, 0xc, 0x10}, {0x75c48f4, 0x7}, 0xc003860000, {0x8022ee8?, 0xc004e10680}, 0x0, {0x0, ...})
test/e2e/network/dns_common.go:455 +0x1c5
k8s.io/kubernetes/test/e2e/network.assertFilesExist(...)
test/e2e/network/dns_common.go:449
k8s.io/kubernetes/test/e2e/network.validateDNSResults(0xc000f87e00, 0xc003860000, {0xc001c80000, 0xc, 0x10})
test/e2e/network/dns_common.go:512 +0x452
k8s.io/kubernetes/test/e2e/network.glob..func2.12()
test/e2e/network/dns.go:613 +0xb92
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func3({0xc002ed5200, 0xc0070a85a0})
vendor/github.com/onsi/ginkgo/v2/internal/node.go:449 +0x1b
k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func2()
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:750 +0x98
created by k8s.io/kubernetes/vendor/github.com/onsi/ginkgo/v2/internal.(*Suite).runNode
vendor/github.com/onsi/ginkgo/v2/internal/suite.go:738 +0xe3d
�[1mSTEP:�[0m deleting the pod �[38;5;243m01/21/23 02:58:15.207�[0m
[AfterEach] [sig-network] DNS
test/e2e/framework/node/init/init.go:32
Jan 21 02:58:15.268: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:58:15.32�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-712". �[38;5;243m01/21/23 02:58:15.32�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/21/23 02:58:15.364�[0m
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:13 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {default-scheduler } Scheduled: Successfully assigned dns-712/dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8 to nodes-us-west1-a-3rdc
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Created: Created container webserver
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Started: Started container webserver
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Created: Created container querier
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Started: Started container querier
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7" already present on machine
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Created: Created container jessie-querier
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:53:14 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Started: Started container jessie-querier
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:58:15 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container webserver
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:58:15 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container jessie-querier
Jan 21 02:58:15.364: INFO: At 2023-01-21 02:58:15 +0000 UTC - event for dns-test-d4282d03-88a6-47c6-b871-e5611fa476b8: {kubelet nodes-us-west1-a-3rdc} Killing: Stopping container querier
Jan 21 02:58:15.408: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 21 02:58:15.408: INFO:
Jan 21 02:58:15.455: INFO:
Logging node info for node control-plane-us-west1-a-f5vg
Jan 21 02:58:15.499: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 51204 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:56:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:56:43 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:58:15.500: INFO:
Logging kubelet events for node control-plane-us-west1-a-f5vg
Jan 21 02:58:15.545: INFO:
Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg
Jan 21 02:58:15.609: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:58:15.610: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:58:15.610: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:58:15.610: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container dns-controller ready: true, restart count 0
Jan 21 02:58:15.610: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container cloud-controller-manager ready: true, restart count 0
Jan 21 02:58:15.610: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container etcd-manager ready: true, restart count 0
Jan 21 02:58:15.610: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 21 02:58:15.610: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container csi-attacher ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Container csi-provisioner ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Container csi-resizer ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:58:15.610: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container healthcheck ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Container kube-apiserver ready: true, restart count 1
Jan 21 02:58:15.610: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:58:15.610: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:58:15.610: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container kops-controller ready: true, restart count 0
Jan 21 02:58:15.610: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container calico-kube-controllers ready: true, restart count 0
Jan 21 02:58:15.610: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.610: INFO: Container kube-scheduler ready: true, restart count 0
Jan 21 02:58:15.839: INFO:
Latency metrics for node control-plane-us-west1-a-f5vg
Jan 21 02:58:15.839: INFO:
Logging node info for node nodes-us-west1-a-3rdc
Jan 21 02:58:15.882: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 54688 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:57:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 02:58:05 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:49 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:49 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:49 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:57:49 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-67a0e4de-9c39-41c4-80ae-21d7c8c11440],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-67a0e4de-9c39-41c4-80ae-21d7c8c11440,DevicePath:,},},Config:nil,},}
Jan 21 02:58:15.883: INFO:
Logging kubelet events for node nodes-us-west1-a-3rdc
Jan 21 02:58:15.927: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc
Jan 21 02:58:15.979: INFO: ss-0 started at 2023-01-21 02:57:48 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.979: INFO: Container webserver ready: true, restart count 0
Jan 21 02:58:15.979: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.979: INFO: Container autoscaler ready: true, restart count 0
Jan 21 02:58:15.979: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.979: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:58:15.979: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:58:15.979: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:58:15.979: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:58:15.979: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.979: INFO: Container coredns ready: true, restart count 0
Jan 21 02:58:15.979: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:58:15.979: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:58:15.979: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:58:15.979: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:58:15.979: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:58:15.979: INFO: my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853-w5nxq started at 2023-01-21 02:56:56 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:15.979: INFO: Container my-hostname-basic-9ccb4eb1-e01f-48b6-b22d-3d5c1621d853 ready: true, restart count 0
Jan 21 02:58:15.979: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded)
Jan 21 02:58:15.979: INFO: Container jessie-querier ready: true, restart count 0
Jan 21 02:58:15.979: INFO: Container querier ready: true, restart count 0
Jan 21 02:58:15.979: INFO: Container webserver ready: true, restart count 0
Jan 21 02:58:16.199: INFO:
Latency metrics for node nodes-us-west1-a-3rdc
Jan 21 02:58:16.199: INFO:
Logging node info for node nodes-us-west1-a-kvqf
Jan 21 02:58:16.251: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 54614 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:58:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:51 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:51 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:51 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:57:51 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 21 02:58:16.251: INFO:
Logging kubelet events for node nodes-us-west1-a-kvqf
Jan 21 02:58:16.305: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf
Jan 21 02:58:16.361: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:58:16.361: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:58:16.361: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:58:16.361: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:16.361: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:58:16.361: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:58:16.361: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:58:16.361: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:58:16.361: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:58:16.361: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:58:16.616: INFO:
Latency metrics for node nodes-us-west1-a-kvqf
Jan 21 02:58:16.616: INFO:
Logging node info for node nodes-us-west1-a-m5ts
Jan 21 02:58:16.660: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 53140 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:57:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-21 02:57:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:57:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:57:10 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/build-image/distroless-iptables@sha256:c0ddb4794bc8a3631e3373015f913c00b230ee54f87bde9ade195b3a3415c60f registry.k8s.io/build-image/distroless-iptables:v0.1.2],SizeBytes:7685585,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-bf08ad11-9bfd-443e-9940-cfaf11ae885d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-bf08ad11-9bfd-443e-9940-cfaf11ae885d,DevicePath:,},},Config:nil,},}
Jan 21 02:58:16.661: INFO:
Logging kubelet events for node nodes-us-west1-a-m5ts
Jan 21 02:58:16.707: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts
Jan 21 02:58:16.756: INFO: ss-1 started at 2023-01-21 02:57:05 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:16.756: INFO: Container webserver ready: false, restart count 0
Jan 21 02:58:16.756: INFO: calico-node-xvbh4 started at 2023-01-21 02:35:45 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:58:16.756: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:58:16.756: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:58:16.756: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:58:16.756: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:58:16.756: INFO: kube-proxy-nodes-us-west1-a-m5ts started at 2023-01-21 02:35:39 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:16.756: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:58:16.756: INFO: csi-gce-pd-node-7dfd6 started at 2023-01-21 02:35:45 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:58:16.756: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:58:16.756: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:58:16.756: INFO: busybox-5dd4d896-3b70-46ba-ba21-12ae929ed292 started at 2023-01-21 02:57:21 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:16.756: INFO: Container busybox ready: true, restart count 0
Jan 21 02:58:16.956: INFO:
Latency metrics for node nodes-us-west1-a-m5ts
Jan 21 02:58:16.956: INFO:
Logging node info for node nodes-us-west1-a-vs1n
Jan 21 02:58:17.000: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-vs1n 42284045-6a79-48c4-8ca2-126d406ddb83 51812 0 2023-01-21 02:35:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-vs1n kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-vs1n topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-vs1n"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.98.97.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:56:55 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:56:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-vs1n,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:47 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:47 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:56:47 +0000 UTC,LastTransitionTime:2023-01-21 02:35:44 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:56:47 +0000 UTC,LastTransitionTime:2023-01-21 02:35:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:35.197.104.211,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-vs1n,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d027d72d1138aa607bac57119d58123f,SystemUUID:d027d72d-1138-aa60-7bac-57119d58123f,BootID:ce5ac2d7-0081-45dc-a156-cbcbaf0daa25,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-1ba2edce-b3d4-470c-9e9b-74974501de01],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/disks/pvc-1ba2edce-b3d4-470c-9e9b-74974501de01,DevicePath:,},},Config:nil,},}
Jan 21 02:58:17.001: INFO:
Logging kubelet events for node nodes-us-west1-a-vs1n
Jan 21 02:58:17.045: INFO:
Logging pods the kubelet thinks is on node nodes-us-west1-a-vs1n
Jan 21 02:58:17.096: INFO: agnhost-primary-4stvk started at 2023-01-21 02:56:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:17.096: INFO: Container agnhost-primary ready: false, restart count 0
Jan 21 02:58:17.096: INFO: csi-gce-pd-node-kkzq7 started at 2023-01-21 02:35:44 +0000 UTC (0+2 container statuses recorded)
Jan 21 02:58:17.096: INFO: Container csi-driver-registrar ready: true, restart count 0
Jan 21 02:58:17.096: INFO: Container gce-pd-driver ready: true, restart count 0
Jan 21 02:58:17.096: INFO: coredns-7bc44848df-bdj2x started at 2023-01-21 02:36:11 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:17.096: INFO: Container coredns ready: true, restart count 0
Jan 21 02:58:17.096: INFO: ss-2 started at 2023-01-21 02:56:38 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:17.096: INFO: Container webserver ready: true, restart count 0
Jan 21 02:58:17.096: INFO: kube-proxy-nodes-us-west1-a-vs1n started at 2023-01-21 02:35:33 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:17.096: INFO: Container kube-proxy ready: true, restart count 0
Jan 21 02:58:17.096: INFO: calico-node-vgrhr started at 2023-01-21 02:35:44 +0000 UTC (3+1 container statuses recorded)
Jan 21 02:58:17.096: INFO: Init container upgrade-ipam ready: true, restart count 0
Jan 21 02:58:17.096: INFO: Init container install-cni ready: true, restart count 0
Jan 21 02:58:17.096: INFO: Init container mount-bpffs ready: true, restart count 0
Jan 21 02:58:17.096: INFO: Container calico-node ready: true, restart count 0
Jan 21 02:58:17.096: INFO: busybox-026312bf-4cb8-4309-9aeb-d7e453e8410e started at 2023-01-21 02:56:24 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:17.096: INFO: Container busybox ready: true, restart count 0
Jan 21 02:58:17.096: INFO: agnhost-primary-2jbfh started at 2023-01-21 02:56:58 +0000 UTC (0+1 container statuses recorded)
Jan 21 02:58:17.096: INFO: Container agnhost-primary ready: false, restart count 0
Jan 21 02:58:17.337: INFO:
Latency metrics for node nodes-us-west1-a-vs1n
[DeferCleanup (Each)] [sig-network] DNS
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "dns-712" for this suite. �[38;5;243m01/21/23 02:58:17.337�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sProxy\sversion\sv1\sA\sset\sof\svalid\sresponses\sare\sreturned\sfor\sboth\spod\sand\sservice\sProxy\s\[Conformance\]$'
test/e2e/network/proxy.go:451 k8s.io/kubernetes/test/e2e/network.glob..func25.1.5() test/e2e/network/proxy.go:451 +0xda8
[BeforeEach] version v1 set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/21/23 02:48:24.589�[0m Jan 21 02:48:24.589: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename proxy �[38;5;243m01/21/23 02:48:24.59�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/21/23 02:48:24.769�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/21/23 02:48:24.854�[0m [BeforeEach] version v1 test/e2e/framework/metrics/init/init.go:31 [It] A set of valid responses are returned for both pod and service Proxy [Conformance] test/e2e/network/proxy.go:380 Jan 21 02:48:24.936: INFO: Creating pod... Jan 21 02:48:25.017: INFO: Waiting up to 5m0s for pod "agnhost" in namespace "proxy-1125" to be "running" Jan 21 02:48:25.070: INFO: Pod "agnhost": Phase="Pending", Reason="", readiness=false. Elapsed: 52.994876ms Jan 21 02:48:27.126: INFO: Pod "agnhost": Phase="Pending", Reason="", readiness=false. Elapsed: 2.108653105s Jan 21 02:48:29.115: INFO: Pod "agnhost": Phase="Running", Reason="", readiness=true. Elapsed: 4.098037724s Jan 21 02:48:29.115: INFO: Pod "agnhost" satisfied condition "running" Jan 21 02:48:29.115: INFO: Creating service... Jan 21 02:48:29.213: INFO: Starting http.Client for https://34.145.25.143/api/v1/namespaces/proxy-1125/pods/agnhost/proxy?method=DELETE Jan 21 02:48:59.297: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Jan 21 02:49:29.350: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Jan 21 02:49:59.407: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Jan 21 02:50:29.481: INFO: http.Client request:DELETE | StatusCode:503 | Response: | Method: Jan 21 02:50:29.481: INFO: Unexpected error: Pod didn't start within time out period. timed out waiting for the condition: <*errors.errorString | 0xc00023ba10>: { s: "timed out waiting for the condition", } Jan 21 02:50:29.481: FAIL: Pod didn't start within time out period. timed out waiting for the condition: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func25.1.5() test/e2e/network/proxy.go:451 +0xda8 [AfterEach] version v1 test/e2e/framework/node/init/init.go:32 Jan 21 02:50:29.481: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] version v1 test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] version v1 dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/21/23 02:50:29.546�[0m �[1mSTEP:�[0m Collecting events from namespace "proxy-1125". �[38;5;243m01/21/23 02:50:29.546�[0m �[1mSTEP:�[0m Found 4 events. �[38;5;243m01/21/23 02:50:29.6�[0m Jan 21 02:50:29.600: INFO: At 2023-01-21 02:48:25 +0000 UTC - event for agnhost: {default-scheduler } Scheduled: Successfully assigned proxy-1125/agnhost to nodes-us-west1-a-3rdc Jan 21 02:50:29.600: INFO: At 2023-01-21 02:48:26 +0000 UTC - event for agnhost: {kubelet nodes-us-west1-a-3rdc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Jan 21 02:50:29.600: INFO: At 2023-01-21 02:48:26 +0000 UTC - event for agnhost: {kubelet nodes-us-west1-a-3rdc} Created: Created container agnhost Jan 21 02:50:29.600: INFO: At 2023-01-21 02:48:26 +0000 UTC - event for agnhost: {kubelet nodes-us-west1-a-3rdc} Started: Started container agnhost Jan 21 02:50:29.649: INFO: POD NODE PHASE GRACE CONDITIONS Jan 21 02:50:29.649: INFO: agnhost nodes-us-west1-a-3rdc Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:48:25 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:48:27 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:48:27 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-21 02:48:24 +0000 UTC }] Jan 21 02:50:29.649: INFO: Jan 21 02:50:29.801: INFO: Logging node info for node control-plane-us-west1-a-f5vg Jan 21 02:50:29.846: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-west1-a-f5vg c7904fd4-8ed4-47ac-b239-55aa1d2f760f 22571 0 2023-01-21 02:34:34 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-west1-a-f5vg kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/control-plane-us-west1-a-f5vg"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.103.2.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:34:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {calico-node Update v1 2023-01-21 02:35:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:type":{}}}}} status} {protokube Update v1 2023-01-21 02:35:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:38 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:45 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-21 02:46:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/control-plane-us-west1-a-f5vg,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332759040 0} {<nil>} 8137460Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227901440 0} {<nil>} 8035060Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:35:45 +0000 UTC,LastTransitionTime:2023-01-21 02:35:45 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:34:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:46:30 +0000 UTC,LastTransitionTime:2023-01-21 02:35:05 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:34.83.51.145,},NodeAddress{Type:Hostname,Address:control-plane-us-west1-a-f5vg,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ac39448583fc38f01281c99ba5c94d09,SystemUUID:ac394485-83fc-38f0-1281-c99ba5c94d09,BootID:b6590034-c926-49d4-85b0-b9a9e61b31b1,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643671,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841306,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:2b6acd7f677f76ffe12ecf3ea7df92eb9b1bdb07336d1ac2a54c7631fb753f7e docker.io/calico/kube-controllers:v3.24.5],SizeBytes:31137169,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[docker.io/k8scloudprovidergcp/cloud-controller-manager@sha256:881fd1095937638040723973ade90e6700f1c831a78fb585a3227c4d021b0df9 docker.io/k8scloudprovidergcp/cloud-controller-manager:latest],SizeBytes:18702875,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965794,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 02:50:29.847: INFO: Logging kubelet events for node control-plane-us-west1-a-f5vg Jan 21 02:50:29.991: INFO: Logging pods the kubelet thinks is on node control-plane-us-west1-a-f5vg Jan 21 02:50:30.089: INFO: calico-kube-controllers-55f488656-dj48t started at 2023-01-21 02:35:38 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container calico-kube-controllers ready: true, restart count 0 Jan 21 02:50:30.089: INFO: kube-scheduler-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container kube-scheduler ready: true, restart count 0 Jan 21 02:50:30.089: INFO: csi-gce-pd-node-rbmsp started at 2023-01-21 02:35:18 +0000 UTC (0+2 container statuses recorded) Jan 21 02:50:30.089: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 02:50:30.089: INFO: kops-controller-ssrcb started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container kops-controller ready: true, restart count 0 Jan 21 02:50:30.089: INFO: etcd-manager-events-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 02:50:30.089: INFO: calico-node-nxdgc started at 2023-01-21 02:34:53 +0000 UTC (3+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Init container upgrade-ipam ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Init container install-cni ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Init container mount-bpffs ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Container calico-node ready: true, restart count 0 Jan 21 02:50:30.089: INFO: cloud-controller-manager-kkzc2 started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container cloud-controller-manager ready: true, restart count 0 Jan 21 02:50:30.089: INFO: etcd-manager-main-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container etcd-manager ready: true, restart count 0 Jan 21 02:50:30.089: INFO: kube-proxy-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container kube-proxy ready: true, restart count 0 Jan 21 02:50:30.089: INFO: dns-controller-6d5f4bf5d6-7g5lv started at 2023-01-21 02:35:19 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container dns-controller ready: true, restart count 0 Jan 21 02:50:30.089: INFO: kube-apiserver-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:45 +0000 UTC (0+2 container statuses recorded) Jan 21 02:50:30.089: INFO: Container healthcheck ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Container kube-apiserver ready: true, restart count 1 Jan 21 02:50:30.089: INFO: kube-controller-manager-control-plane-us-west1-a-f5vg started at 2023-01-21 02:33:46 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.089: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 21 02:50:30.089: INFO: csi-gce-pd-controller-78fc966fff-btx4c started at 2023-01-21 02:35:19 +0000 UTC (0+5 container statuses recorded) Jan 21 02:50:30.089: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 02:50:30.089: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 02:50:30.500: INFO: Latency metrics for node control-plane-us-west1-a-f5vg Jan 21 02:50:30.500: INFO: Logging node info for node nodes-us-west1-a-3rdc Jan 21 02:50:30.543: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-3rdc 164f856b-ce1a-4d48-8ed2-eb9f3c240d1c 32453 0 2023-01-21 02:35:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-3rdc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-3rdc topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-8051":"nodes-us-west1-a-3rdc","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-3rdc"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.110.221.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{cloud-controller-manager Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kubelet Update v1 2023-01-21 02:35:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-21 02:35:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:50:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-3rdc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:04 +0000 UTC,LastTransitionTime:2023-01-21 02:36:04 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:20 +0000 UTC,LastTransitionTime:2023-01-21 02:35:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:34.82.212.50,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-3rdc,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a428698dccd42bee79026b2fa455662b,SystemUUID:a428698d-ccd4-2bee-7902-6b2fa455662b,BootID:edd10ec5-5fcc-4958-92d4-ee6a421ad343,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 02:50:30.543: INFO: Logging kubelet events for node nodes-us-west1-a-3rdc Jan 21 02:50:30.595: INFO: Logging pods the kubelet thinks is on node nodes-us-west1-a-3rdc Jan 21 02:50:30.652: INFO: sample-webhook-deployment-865554f4d9-rz9h2 started at 2023-01-21 02:49:43 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container sample-webhook ready: true, restart count 0 Jan 21 02:50:30.652: INFO: dns-test-05dfe736-5072-416f-8f1d-1cb5f4f7c61e started at 2023-01-21 02:48:11 +0000 UTC (0+3 container statuses recorded) Jan 21 02:50:30.652: INFO: Container jessie-querier ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container querier ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container webserver ready: true, restart count 0 Jan 21 02:50:30.652: INFO: pod-2 started at 2023-01-21 02:49:42 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container donothing ready: true, restart count 0 Jan 21 02:50:30.652: INFO: pod-0 started at 2023-01-21 02:49:41 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container donothing ready: true, restart count 0 Jan 21 02:50:30.652: INFO: agnhost started at 2023-01-21 02:48:25 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container agnhost ready: true, restart count 0 Jan 21 02:50:30.652: INFO: coredns-autoscaler-7cb5c5b969-p8bdv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container autoscaler ready: true, restart count 0 Jan 21 02:50:30.652: INFO: kube-proxy-nodes-us-west1-a-3rdc started at 2023-01-21 02:35:40 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container kube-proxy ready: true, restart count 0 Jan 21 02:50:30.652: INFO: csi-gce-pd-node-n9dfk started at 2023-01-21 02:35:40 +0000 UTC (0+2 container statuses recorded) Jan 21 02:50:30.652: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 02:50:30.652: INFO: coredns-7bc44848df-t54pv started at 2023-01-21 02:35:56 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container coredns ready: true, restart count 0 Jan 21 02:50:30.652: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:49:57 +0000 UTC (0+7 container statuses recorded) Jan 21 02:50:30.652: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container hostpath ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 02:50:30.652: INFO: calico-node-ptzr6 started at 2023-01-21 02:35:40 +0000 UTC (3+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Init container upgrade-ipam ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Init container install-cni ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Init container mount-bpffs ready: true, restart count 0 Jan 21 02:50:30.652: INFO: Container calico-node ready: true, restart count 0 Jan 21 02:50:30.652: INFO: webserver-pod started at 2023-01-21 02:46:09 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:30.652: INFO: Container agnhost ready: false, restart count 0 Jan 21 02:50:30.982: INFO: Latency metrics for node nodes-us-west1-a-3rdc Jan 21 02:50:30.982: INFO: Logging node info for node nodes-us-west1-a-kvqf Jan 21 02:50:31.029: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-kvqf f5aaf00f-e8e3-466f-beea-61cb20e29193 32774 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-kvqf kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-kvqf topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-7269":"nodes-us-west1-a-kvqf","csi-mock-csi-mock-volumes-1679":"nodes-us-west1-a-kvqf","pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-kvqf"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.124.229.0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:44 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:50:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-21 02:50:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-kvqf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111196160 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006338560 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:09 +0000 UTC,LastTransitionTime:2023-01-21 02:36:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:50:25 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:34.105.56.95,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-kvqf,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d009bc85165ef1fe26e79ded94b13119,SystemUUID:d009bc85-165e-f1fe-26e7-9ded94b13119,BootID:9c68b967-2697-4d9e-9956-2ef55afd9e35,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-7269^47ba39c6-9936-11ed-a191-fa7134f3118a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-7269^47ba39c6-9936-11ed-a191-fa7134f3118a,DevicePath:,},},Config:nil,},} Jan 21 02:50:31.030: INFO: Logging kubelet events for node nodes-us-west1-a-kvqf Jan 21 02:50:31.081: INFO: Logging pods the kubelet thinks is on node nodes-us-west1-a-kvqf Jan 21 02:50:31.141: INFO: csi-gce-pd-node-wk8n7 started at 2023-01-21 02:35:42 +0000 UTC (0+2 container statuses recorded) Jan 21 02:50:31.141: INFO: Container csi-driver-registrar ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container gce-pd-driver ready: true, restart count 0 Jan 21 02:50:31.141: INFO: kube-proxy-nodes-us-west1-a-kvqf started at 2023-01-21 02:35:32 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Container kube-proxy ready: true, restart count 0 Jan 21 02:50:31.141: INFO: csi-mockplugin-attacher-0 started at 2023-01-21 02:49:56 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 02:50:31.141: INFO: hostexec-nodes-us-west1-a-kvqf-kwd4z started at 2023-01-21 02:50:30 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Container agnhost-container ready: false, restart count 0 Jan 21 02:50:31.141: INFO: pod-ed9373a7-8b13-4731-84db-ef67ef046490 started at 2023-01-21 02:50:30 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Container write-pod ready: false, restart count 0 Jan 21 02:50:31.141: INFO: calico-node-4tgmz started at 2023-01-21 02:35:42 +0000 UTC (3+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Init container upgrade-ipam ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Init container install-cni ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Init container mount-bpffs ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container calico-node ready: true, restart count 0 Jan 21 02:50:31.141: INFO: csi-mockplugin-0 started at 2023-01-21 02:49:56 +0000 UTC (0+3 container statuses recorded) Jan 21 02:50:31.141: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container driver-registrar ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container mock ready: true, restart count 0 Jan 21 02:50:31.141: INFO: hostexec-nodes-us-west1-a-kvqf-mbtck started at 2023-01-21 02:50:25 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Container agnhost-container ready: true, restart count 0 Jan 21 02:50:31.141: INFO: csi-hostpathplugin-0 started at 2023-01-21 02:49:44 +0000 UTC (0+7 container statuses recorded) Jan 21 02:50:31.141: INFO: Container csi-attacher ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container csi-provisioner ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container csi-resizer ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container hostpath ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container liveness-probe ready: true, restart count 0 Jan 21 02:50:31.141: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 21 02:50:31.141: INFO: deployment-shared-unset-7cf876c5d4-6q4bv started at 2023-01-21 02:49:15 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Container nginx ready: false, restart count 0 Jan 21 02:50:31.141: INFO: pod-7f71e36a-8ead-4fbe-9728-884680c8d366 started at 2023-01-21 02:49:55 +0000 UTC (0+1 container statuses recorded) Jan 21 02:50:31.141: INFO: Container write-pod ready: true, restart count 0 Jan 21 02:50:31.469: INFO: Latency metrics for node nodes-us-west1-a-kvqf Jan 21 02:50:31.469: INFO: Logging node info for node nodes-us-west1-a-m5ts Jan 21 02:50:31.519: INFO: Node Info: &Node{ObjectMeta:{nodes-us-west1-a-m5ts dbb68e24-9e22-4646-bab7-88caf8dd9121 28189 0 2023-01-21 02:35:42 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-west1-a-m5ts kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.hostpath.csi/node:nodes-us-west1-a-m5ts topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/e2e-gce-gci-ci-master-slow/zones/us-west1-a/instances/nodes-us-west1-a-m5ts"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.126.171.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-21 02:35:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-01-21 02:35:46 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {cloud-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}}},"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{".":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-21 02:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {calico-node Update v1 2023-01-21 02:36:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{}}}}} status} {kubelet Update v1 2023-01-21 02:48:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://e2e-gce-gci-ci-master-slow/us-west1-a/nodes-us-west1-a-m5ts,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111187968 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006330368 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-21 02:36:05 +0000 UTC,LastTransitionTime:2023-01-21 02:36:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:42 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-21 02:48:09 +0000 UTC,LastTransitionTime:2023-01-21 02:35:56 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.247.119.178,},NodeAddress{Type:Hostname,Address:nodes-us-west1-a-m5ts,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:1c837450cfaa94337c63c7ed0518d04f,SystemUUID:1c837450-cfaa-9433-7c63-c7ed0518d04f,BootID:19f0e48b-d0f1-48d8-a01b-f0f855cf6d9e,KernelVersion:5.15.0-1021-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/cni@sha256:e282ea2914c806b5de2976330a17cfb5e6dcef47147bceb1432ca5c75fd46f50 docker.io/calico/cni:v3.24.5],SizeBytes:87458443,},ContainerImage{Names:[docker.io/calico/node@sha256:5972ad2bcbdc668564d3e26960c9c513b2d7b05581c704747cf7c62ef3a405a6 docker.io/calico/node:v3.24.5],SizeBytes:81584866,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 21 02:50:31.520: INFO: Logging kubelet events for node nodes-us-west1-a-m5ts Jan 21 02:50:31.565: INFO: Logging pods the kubelet thinks is on node nodes-us-west1-a-m5ts Jan 21 02:50:31.618: INFO: pod-configmaps-6bffb42b-68fe-4f90-90a8-f0c7a99f0f68 started at 2023-01-21 02:48:50 +0000 UTC (0+3 container statuses recorded) Jan 21 02:50:31.618: INFO: Container createcm-volume-test ready: true, restart count 0 Jan 21 02:50:31.618: INFO: Container delcm-volume-test ready: true, restart count 0 Jan 21 02:50:31.618: INFO: