Result | FAILURE |
Tests | 20 failed / 789 succeeded |
Started | |
Elapsed | 58m27s |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\spatching\/updating\sa\smutating\swebhook\sshould\swork\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:31:10.921: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00025e240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:527from junit_21.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Mar 25 21:30:26.624: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Mar 25 21:30:27.176: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set �[1mSTEP�[0m: Deploying the webhook service �[1mSTEP�[0m: Verifying the service has paired with the endpoint Mar 25 21:30:30.270: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] patching/updating a mutating webhook should work [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 �[1mSTEP�[0m: Creating a mutating webhook configuration Mar 25 21:30:30.438: INFO: Waiting for webhook configuration to be ready... Mar 25 21:30:40.562: INFO: Waiting for webhook configuration to be ready... Mar 25 21:30:50.672: INFO: Waiting for webhook configuration to be ready... Mar 25 21:31:00.838: INFO: Waiting for webhook configuration to be ready... Mar 25 21:31:10.921: INFO: Waiting for webhook configuration to be ready... Mar 25 21:31:10.921: FAIL: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00025e240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.17() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:527 +0x372 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24efc17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0002a4820, 0x72ee990) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "webhook-4602". �[1mSTEP�[0m: Found 6 events. Mar 25 21:31:10.982: INFO: At 2023-03-25 21:30:27 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-6c69dbd86b to 1 Mar 25 21:31:10.982: INFO: At 2023-03-25 21:30:27 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-6c69dbd86b-gfjlj Mar 25 21:31:10.982: INFO: At 2023-03-25 21:30:27 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-gfjlj: {default-scheduler } Scheduled: Successfully assigned webhook-4602/sample-webhook-deployment-6c69dbd86b-gfjlj to nodes-us-central1-c-n8lj Mar 25 21:31:10.982: INFO: At 2023-03-25 21:30:28 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-gfjlj: {kubelet nodes-us-central1-c-n8lj} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Mar 25 21:31:10.982: INFO: At 2023-03-25 21:30:28 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-gfjlj: {kubelet nodes-us-central1-c-n8lj} Created: Created container sample-webhook Mar 25 21:31:10.982: INFO: At 2023-03-25 21:30:28 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-gfjlj: {kubelet nodes-us-central1-c-n8lj} Started: Started container sample-webhook Mar 25 21:31:11.000: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:31:11.000: INFO: sample-webhook-deployment-6c69dbd86b-gfjlj nodes-us-central1-c-n8lj Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:30:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:30:28 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:30:28 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:30:27 +0000 UTC }] Mar 25 21:31:11.000: INFO: Mar 25 21:31:11.117: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:31:11.151: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 42887 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:31:11.151: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:31:11.168: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:31:11.215: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:31:11.215: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:31:11.215: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:11.215: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:11.215: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:31:11.215: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:11.215: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:11.215: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:31:11.215: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:11.215: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:31:11.215: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:31:11.215: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:31:11.215: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:11.215: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:31:11.215: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:31:11.215: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.215: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:31:11.526: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:31:11.526: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:31:11.548: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 42866 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2971":"csi-mock-csi-mock-volumes-2971","csi-mock-csi-mock-volumes-623":"csi-mock-csi-mock-volumes-623","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:31:11.548: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:31:11.582: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:31:11.651: INFO: csi-mockplugin-0 started at 2023-03-25 21:30:15 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container mock ready: true, restart count 0 Mar 25 21:31:11.651: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-attacher ready: false, restart count 0 Mar 25 21:31:11.651: INFO: pod-projected-configmaps-3c237d01-6df9-49e1-ae15-b4a7dbecf395 started at 2023-03-25 21:30:42 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:11.651: INFO: Container createcm-volume-test ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container delcm-volume-test ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container updcm-volume-test ready: true, restart count 0 Mar 25 21:31:11.651: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:11.651: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:11.651: INFO: csi-mockplugin-resizer-0 started at 2023-03-25 21:31:06 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-resizer ready: false, restart count 0 Mar 25 21:31:11.651: INFO: pvc-volume-tester-j7sjb started at 2023-03-25 21:31:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Container volume-tester ready: false, restart count 0 Mar 25 21:31:11.651: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:29:54 +0000 UTC (0+7 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:31:11.651: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:30:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:11.651: INFO: csi-mockplugin-0 started at 2023-03-25 21:31:05 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-provisioner ready: false, restart count 0 Mar 25 21:31:11.651: INFO: Container driver-registrar ready: false, restart count 0 Mar 25 21:31:11.651: INFO: Container mock ready: false, restart count 0 Mar 25 21:31:11.651: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:11.651: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:11.651: INFO: csi-mockplugin-0 started at 2023-03-25 21:29:16 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container mock ready: true, restart count 0 Mar 25 21:31:11.651: INFO: update-demo-nautilus-tbrmw started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:31:11.651: INFO: httpd-deployment-5bf95dfb4d-sp8dl started at 2023-03-25 21:29:39 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:11.651: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:11.651: INFO: csi-mockplugin-0 started at 2023-03-25 21:30:58 +0000 UTC (0+4 container statuses recorded) Mar 25 21:31:11.651: INFO: Container busybox ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container mock ready: true, restart count 0 Mar 25 21:31:11.651: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:11.651: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:11.651: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:12.935: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:31:12.936: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:31:12.945: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 42839 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:dd6d57960dc104a4ee0fa7c58c6faa3e38725561af374c17f8cb905f7f73ba66 k8s.gcr.io/build-image/debian-iptables:bullseye-v1.1.0],SizeBytes:27059231,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-2f2bb96c-d2f2-4a6d-8253-650a38a2f432],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:31:12.945: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:31:12.957: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:31:13.004: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:13.004: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:13.004: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:13.004: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:13.004: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:13.004: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:13.004: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:13.004: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:13.004: INFO: pod-c843c677-254b-4dcf-b0bd-e86a85fae02c started at 2023-03-25 21:30:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:31:13.004: INFO: master started at 2023-03-25 21:30:51 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:13.004: INFO: default started at 2023-03-25 21:30:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:13.004: INFO: test-webserver-03789235-6916-41a6-8c25-d26d5d7e114f started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container test-webserver ready: false, restart count 0 Mar 25 21:31:13.004: INFO: affinity-nodeport-transition-gsnfk started at 2023-03-25 21:31:11 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Mar 25 21:31:13.004: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:13.004: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:13.004: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:13.004: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:13.004: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:13.004: INFO: dns-test-105cc4fa-26dc-4534-a134-55e045d90aca started at 2023-03-25 21:17:53 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:13.004: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:31:13.004: INFO: Container querier ready: true, restart count 1 Mar 25 21:31:13.004: INFO: Container webserver ready: true, restart count 0 Mar 25 21:31:13.004: INFO: pod-service-account-mountsa-mountspec started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container token-test ready: false, restart count 0 Mar 25 21:31:13.004: INFO: private started at 2023-03-25 21:30:55 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:13.004: INFO: httpd started at 2023-03-25 21:31:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:13.004: INFO: oidc-discovery-validator started at 2023-03-25 21:30:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container oidc-discovery-validator ready: false, restart count 0 Mar 25 21:31:13.004: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container coredns ready: true, restart count 0 Mar 25 21:31:13.004: INFO: hostexec-nodes-us-central1-c-lhrm-5d5wh started at 2023-03-25 21:31:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:31:13.004: INFO: slave started at 2023-03-25 21:30:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.004: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:13.207: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:31:13.207: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:31:13.231: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 42958 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-310":"nodes-us-central1-c-n8lj","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:31:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-310^575d493b-cb54-11ed-9209-be2726040b25],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-310^575d493b-cb54-11ed-9209-be2726040b25,DevicePath:,},},Config:nil,},} Mar 25 21:31:13.231: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:31:13.254: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:31:13.367: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:30:42 +0000 UTC (0+7 container statuses recorded) Mar 25 21:31:13.367: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:13.367: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:13.367: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:31:13.368: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:13.368: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container querier ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container webserver ready: true, restart count 0 Mar 25 21:31:13.368: INFO: hostexec-nodes-us-central1-c-n8lj-qp68c started at 2023-03-25 21:31:09 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:31:13.368: INFO: pod-secrets-db17b140-6c9d-4cde-a8dd-1fcc8f873295 started at 2023-03-25 21:30:58 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:13.368: INFO: Container creates-volume-test ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container dels-volume-test ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container upds-volume-test ready: true, restart count 0 Mar 25 21:31:13.368: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:13.368: INFO: startup-cf03f1b7-d575-4dc5-9d7a-cd83181c11b4 started at 2023-03-25 21:30:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container busybox ready: false, restart count 0 Mar 25 21:31:13.368: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:13.368: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:13.368: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container querier ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container webserver ready: true, restart count 0 Mar 25 21:31:13.368: INFO: update-demo-nautilus-wxf8x started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:31:13.368: INFO: slow-terminating-unready-pod-nd7w8 started at 2023-03-25 21:28:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 25 21:31:13.368: INFO: hostpath-client started at 2023-03-25 21:31:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container hostpath-client ready: false, restart count 0 Mar 25 21:31:13.368: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:13.368: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:13.368: INFO: httpd-deployment-95bc5655f-t49qt started at 2023-03-25 21:29:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:13.368: INFO: sample-webhook-deployment-6c69dbd86b-gfjlj started at 2023-03-25 21:30:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:31:13.368: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:13.368: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:13.368: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:13.368: INFO: affinity-nodeport-transition-wcc5p started at 2023-03-25 21:31:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Mar 25 21:31:13.368: INFO: httpd-deployment-5bf95dfb4d-d8nvn started at 2023-03-25 21:29:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:13.368: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:14.181: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:31:14.181: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:31:14.192: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 42869 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-3067":"nodes-us-central1-c-wcck","csi-mock-csi-mock-volumes-4737":"csi-mock-csi-mock-volumes-4737","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:31:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-3067^59e472c2-cb54-11ed-93e8-bab3dab44b14],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-3067^59e472c2-cb54-11ed-93e8-bab3dab44b14,DevicePath:,},},Config:nil,},} Mar 25 21:31:14.192: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:31:14.223: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:31:14.241: INFO: pod-configmaps-e0c13d86-6d45-4721-b289-fb99b2d92e94 started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:31:14.241: INFO: pod-78c85ff6-5e4d-4f65-9517-52fe81e45fd8 started at 2023-03-25 21:31:08 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:31:14.241: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:30:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:14.241: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:14.241: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container coredns ready: true, restart count 0 Mar 25 21:31:14.241: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:31:14.241: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:14.241: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:14.241: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:14.241: INFO: csi-mockplugin-0 started at 2023-03-25 21:30:31 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:14.241: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container mock ready: true, restart count 0 Mar 25 21:31:14.241: INFO: pod-service-account-mountsa started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container token-test ready: false, restart count 0 Mar 25 21:31:14.241: INFO: pod-service-account-defaultsa started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.241: INFO: Container token-test ready: false, restart count 0 Mar 25 21:31:14.241: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:31:02 +0000 UTC (0+7 container statuses recorded) Mar 25 21:31:14.241: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:31:14.241: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:14.241: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:14.241: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:14.482: INFO: Latency metrics for node nodes-us-central1-c-wcck �[1mSTEP�[0m: Collecting events from namespace "webhook-4602-markers". �[1mSTEP�[0m: Found 0 events. Mar 25 21:31:14.519: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:31:14.519: INFO: Mar 25 21:31:14.545: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:31:14.571: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 42887 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:31:14.571: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:31:14.585: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:31:14.615: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.615: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:31:14.615: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:31:14.616: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:14.616: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:31:14.616: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:31:14.616: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:14.616: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:31:14.616: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:14.616: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:31:14.616: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:31:14.616: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:14.616: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:14.616: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:31:14.616: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:14.616: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:14.616: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:14.616: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:31:14.936: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:31:14.936: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:31:14.949: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 42866 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2971":"csi-mock-csi-mock-volumes-2971","csi-mock-csi-mock-volumes-623":"csi-mock-csi-mock-volumes-623","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:31:14.950: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:31:14.970: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:31:15.101: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:15.101: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:15.101: INFO: csi-mockplugin-resizer-0 started at 2023-03-25 21:31:06 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.101: INFO: Container csi-resizer ready: false, restart count 0 Mar 25 21:31:15.101: INFO: pvc-volume-tester-j7sjb started at 2023-03-25 21:31:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.101: INFO: Container volume-tester ready: false, restart count 0 Mar 25 21:31:15.101: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:29:54 +0000 UTC (0+7 container statuses recorded) Mar 25 21:31:15.101: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:31:15.101: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:31:15.101: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:30:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.101: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:15.101: INFO: pod-ephm-test-projected-gnpx started at 2023-03-25 21:31:13 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.102: INFO: Container test-container-subpath-projected-gnpx ready: false, restart count 0 Mar 25 21:31:15.102: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.102: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:15.102: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:15.102: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:15.102: INFO: csi-mockplugin-0 started at 2023-03-25 21:29:16 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:15.102: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container mock ready: true, restart count 0 Mar 25 21:31:15.102: INFO: csi-mockplugin-0 started at 2023-03-25 21:31:05 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:15.102: INFO: Container csi-provisioner ready: false, restart count 0 Mar 25 21:31:15.102: INFO: Container driver-registrar ready: false, restart count 0 Mar 25 21:31:15.102: INFO: Container mock ready: false, restart count 0 Mar 25 21:31:15.102: INFO: update-demo-nautilus-tbrmw started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.102: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:31:15.102: INFO: httpd-deployment-5bf95dfb4d-sp8dl started at 2023-03-25 21:29:39 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.102: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:15.102: INFO: csi-mockplugin-0 started at 2023-03-25 21:30:58 +0000 UTC (0+4 container statuses recorded) Mar 25 21:31:15.102: INFO: Container busybox ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container mock ready: true, restart count 0 Mar 25 21:31:15.102: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:15.102: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:15.102: INFO: affinity-nodeport-transition-5qfzk started at 2023-03-25 21:31:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.102: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Mar 25 21:31:15.102: INFO: csi-mockplugin-0 started at 2023-03-25 21:30:15 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:15.102: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:31:15.102: INFO: Container mock ready: true, restart count 0 Mar 25 21:31:15.102: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:15.102: INFO: Container csi-attacher ready: false, restart count 0 Mar 25 21:31:17.162: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:31:17.162: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:31:17.181: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 43097 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:14 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:08 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:dd6d57960dc104a4ee0fa7c58c6faa3e38725561af374c17f8cb905f7f73ba66 k8s.gcr.io/build-image/debian-iptables:bullseye-v1.1.0],SizeBytes:27059231,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-2f2bb96c-d2f2-4a6d-8253-650a38a2f432],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-2f2bb96c-d2f2-4a6d-8253-650a38a2f432,DevicePath:,},},Config:nil,},} Mar 25 21:31:17.181: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:31:17.193: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:31:17.214: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:17.214: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:17.214: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:17.214: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:17.214: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:17.214: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:17.214: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:17.214: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:17.214: INFO: pod-c843c677-254b-4dcf-b0bd-e86a85fae02c started at 2023-03-25 21:30:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:31:17.214: INFO: affinity-nodeport-transition-gsnfk started at 2023-03-25 21:31:11 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Mar 25 21:31:17.214: INFO: master started at 2023-03-25 21:30:51 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:17.214: INFO: default started at 2023-03-25 21:30:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:17.214: INFO: test-webserver-03789235-6916-41a6-8c25-d26d5d7e114f started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container test-webserver ready: false, restart count 0 Mar 25 21:31:17.214: INFO: pod-service-account-mountsa-mountspec started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container token-test ready: false, restart count 0 Mar 25 21:31:17.214: INFO: private started at 2023-03-25 21:30:55 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:17.214: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:17.214: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:17.214: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:17.214: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:17.214: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:17.214: INFO: dns-test-105cc4fa-26dc-4534-a134-55e045d90aca started at 2023-03-25 21:17:53 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:17.214: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:31:17.214: INFO: Container querier ready: true, restart count 1 Mar 25 21:31:17.214: INFO: Container webserver ready: true, restart count 0 Mar 25 21:31:17.214: INFO: httpd started at 2023-03-25 21:31:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:17.214: INFO: oidc-discovery-validator started at 2023-03-25 21:30:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container oidc-discovery-validator ready: false, restart count 0 Mar 25 21:31:17.214: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container coredns ready: true, restart count 0 Mar 25 21:31:17.214: INFO: slave started at 2023-03-25 21:30:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.214: INFO: Container cntr ready: true, restart count 0 Mar 25 21:31:17.399: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:31:17.399: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:31:17.405: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 42958 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-310":"nodes-us-central1-c-n8lj","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:04 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:31:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:12 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-310^575d493b-cb54-11ed-9209-be2726040b25],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-310^575d493b-cb54-11ed-9209-be2726040b25,DevicePath:,},},Config:nil,},} Mar 25 21:31:17.405: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:31:17.414: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:31:17.429: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.429: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:17.429: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:17.429: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:31:17.429: INFO: Container querier ready: true, restart count 0 Mar 25 21:31:17.429: INFO: Container webserver ready: true, restart count 0 Mar 25 21:31:17.429: INFO: update-demo-nautilus-wxf8x started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.429: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:31:17.429: INFO: slow-terminating-unready-pod-nd7w8 started at 2023-03-25 21:28:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.429: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 25 21:31:17.429: INFO: hostpath-client started at 2023-03-25 21:31:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.429: INFO: Container hostpath-client ready: false, restart count 0 Mar 25 21:31:17.429: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:17.429: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:17.429: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:17.429: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:17.429: INFO: httpd-deployment-95bc5655f-t49qt started at 2023-03-25 21:29:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.430: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:17.430: INFO: sample-webhook-deployment-6c69dbd86b-gfjlj started at 2023-03-25 21:30:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.430: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:31:17.430: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:17.430: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:17.430: INFO: affinity-nodeport-transition-wcc5p started at 2023-03-25 21:31:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.430: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Mar 25 21:31:17.430: INFO: httpd-deployment-5bf95dfb4d-d8nvn started at 2023-03-25 21:29:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.430: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:17.430: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:30:42 +0000 UTC (0+7 container statuses recorded) Mar 25 21:31:17.430: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:31:17.430: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:17.430: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container querier ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container webserver ready: true, restart count 0 Mar 25 21:31:17.430: INFO: hostexec-nodes-us-central1-c-n8lj-qp68c started at 2023-03-25 21:31:09 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.430: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:31:17.430: INFO: pod-secrets-db17b140-6c9d-4cde-a8dd-1fcc8f873295 started at 2023-03-25 21:30:58 +0000 UTC (0+3 container statuses recorded) Mar 25 21:31:17.430: INFO: Container creates-volume-test ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container dels-volume-test ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container upds-volume-test ready: true, restart count 0 Mar 25 21:31:17.430: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:17.430: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:17.430: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:17.430: INFO: startup-cf03f1b7-d575-4dc5-9d7a-cd83181c11b4 started at 2023-03-25 21:30:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:17.430: INFO: Container busybox ready: false, restart count 0 Mar 25 21:31:18.185: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:31:18.185: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:31:18.191: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 43135 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-volume-expand-3067":"nodes-us-central1-c-wcck","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:31:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-volume-expand-3067^59e472c2-cb54-11ed-93e8-bab3dab44b14],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-volume-expand-3067^59e472c2-cb54-11ed-93e8-bab3dab44b14,DevicePath:,},},Config:nil,},} Mar 25 21:31:18.192: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:31:18.210: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:31:18.224: INFO: pod-service-account-mountsa started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:18.224: INFO: Container token-test ready: false, restart count 0 Mar 25 21:31:18.224: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:31:02 +0000 UTC (0+7 container statuses recorded) Mar 25 21:31:18.224: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:31:18.224: INFO: pod-service-account-defaultsa started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:18.224: INFO: Container token-test ready: false, restart count 0 Mar 25 21:31:18.224: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:31:18.224: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:31:18.224: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:31:18.224: INFO: pod-configmaps-e0c13d86-6d45-4721-b289-fb99b2d92e94 started at 2023-03-25 21:29:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:18.224: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:31:18.224: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:18.224: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:31:18.224: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:18.225: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:31:18.225: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:18.225: INFO: Container coredns ready: true, restart count 0 Mar 25 21:31:18.225: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:31:18.225: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:31:18.225: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:31:18.225: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:31:18.225: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:31:18.225: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:31:18.225: INFO: httpd started at 2023-03-25 21:31:17 +0000 UTC (0+1 container statuses recorded) Mar 25 21:31:18.225: INFO: Container httpd ready: false, restart count 0 Mar 25 21:31:18.225: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:31:18.225: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:31:18.225: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:31:18.474: INFO: Latency metrics for node nodes-us-central1-c-wcck Mar 25 21:31:18.474: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "webhook-4602" for this suite. �[1mSTEP�[0m: Destroying namespace "webhook-4602-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\scustom\sresource\screation\,\supdate\sand\sdeletion\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:28:13.734: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc000230230>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1727from junit_03.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Mar 25 21:27:19.097: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Mar 25 21:27:19.764: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set �[1mSTEP�[0m: Deploying the webhook service �[1mSTEP�[0m: Verifying the service has paired with the endpoint Mar 25 21:27:22.794: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should be able to deny custom resource creation, update and deletion [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:27:22.799: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Registering the custom resource webhook via the AdmissionRegistration API Mar 25 21:27:33.370: INFO: Waiting for webhook configuration to be ready... Mar 25 21:27:43.487: INFO: Waiting for webhook configuration to be ready... Mar 25 21:27:53.669: INFO: Waiting for webhook configuration to be ready... Mar 25 21:28:03.718: INFO: Waiting for webhook configuration to be ready... Mar 25 21:28:13.733: INFO: Waiting for webhook configuration to be ready... Mar 25 21:28:13.734: FAIL: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc000230230>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerWebhookForCustomResource(0xc000b2b8c0, {0xc00335cc30, 0xc}, 0xc003403720, 0xc0047a4d40, 0x0?) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1727 +0x845 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.6() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:224 +0xad k8s.io/kubernetes/test/e2e.RunE2ETests(0x24efc17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0xc000488fd0?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0006d5040, 0x72ee990) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "webhook-8200". �[1mSTEP�[0m: Found 6 events. Mar 25 21:28:14.276: INFO: At 2023-03-25 21:27:19 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-6c69dbd86b to 1 Mar 25 21:28:14.276: INFO: At 2023-03-25 21:27:19 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-6c69dbd86b-6k8pb Mar 25 21:28:14.276: INFO: At 2023-03-25 21:27:19 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-6k8pb: {default-scheduler } Scheduled: Successfully assigned webhook-8200/sample-webhook-deployment-6c69dbd86b-6k8pb to nodes-us-central1-c-n8lj Mar 25 21:28:14.276: INFO: At 2023-03-25 21:27:20 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-6k8pb: {kubelet nodes-us-central1-c-n8lj} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Mar 25 21:28:14.276: INFO: At 2023-03-25 21:27:20 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-6k8pb: {kubelet nodes-us-central1-c-n8lj} Created: Created container sample-webhook Mar 25 21:28:14.276: INFO: At 2023-03-25 21:27:21 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-6k8pb: {kubelet nodes-us-central1-c-n8lj} Started: Started container sample-webhook Mar 25 21:28:14.296: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:28:14.296: INFO: sample-webhook-deployment-6c69dbd86b-6k8pb nodes-us-central1-c-n8lj Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:27:19 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:27:21 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:27:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:27:19 +0000 UTC }] Mar 25 21:28:14.296: INFO: Mar 25 21:28:14.318: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:28:14.322: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 29910 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:28:14.323: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:28:14.336: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:28:14.375: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:14.375: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:28:14.375: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:28:14.375: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:14.375: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:28:14.375: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:14.375: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:28:14.375: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:28:14.375: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:28:14.375: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:14.375: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:14.375: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:28:14.375: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:14.375: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:28:14.375: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:28:14.375: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:28:14.375: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:28:14.754: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:28:14.754: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:28:14.761: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 34752 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:27:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:27:57 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-3ee43c51-cad0-46e4-9d89-3b69174c8715],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-3ee43c51-cad0-46e4-9d89-3b69174c8715,DevicePath:,},},Config:nil,},} Mar 25 21:28:14.762: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:28:14.775: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:28:14.879: INFO: hostexec-nodes-us-central1-c-h9x3-b9kfl started at 2023-03-25 21:28:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:28:14.879: INFO: pod-1 started at 2023-03-25 21:28:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:28:14.879: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:14.879: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:14.879: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:14.879: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:14.879: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:14.879: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:14.879: INFO: failed-jobs-history-limit-27996328-jbz5x started at 2023-03-25 21:28:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container c ready: false, restart count 0 Mar 25 21:28:14.879: INFO: update-demo-nautilus-tbrmw started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:28:14.879: INFO: ss2-2 started at 2023-03-25 21:27:44 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:14.879: INFO: rs-xw54v started at 2023-03-25 21:27:55 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container donothing ready: true, restart count 0 Mar 25 21:28:14.879: INFO: pod-bb3c7aee-6869-463c-8530-c4fe1460a6d4 started at 2023-03-25 21:28:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.879: INFO: Container test-container ready: false, restart count 0 Mar 25 21:28:14.879: INFO: e2e-test-httpd-pod started at <nil> (0+0 container statuses recorded) Mar 25 21:28:14.879: INFO: successful-jobs-history-limit-27996328-z96z9 started at 2023-03-25 21:28:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.880: INFO: Container c ready: false, restart count 0 Mar 25 21:28:14.880: INFO: ss-1 started at 2023-03-25 21:27:46 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.880: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:14.880: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:14.880: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:14.880: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:14.880: INFO: e2e-test-httpd-pod started at 2023-03-25 21:28:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.880: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 Mar 25 21:28:14.880: INFO: alpine-nnp-false-782ebc26-8d83-4f3a-9e10-5a2ae7356db4 started at 2023-03-25 21:27:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.880: INFO: Container alpine-nnp-false-782ebc26-8d83-4f3a-9e10-5a2ae7356db4 ready: false, restart count 0 Mar 25 21:28:14.880: INFO: netserver-0 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.880: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:14.880: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:14.880: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:14.880: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:14.880: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:14.880: INFO: agnhost-primary-87thk started at 2023-03-25 21:27:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:14.880: INFO: Container agnhost-primary ready: false, restart count 0 Mar 25 21:28:16.654: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:28:16.654: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:28:16.663: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 35039 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8522":"nodes-us-central1-c-lhrm","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:27:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:28:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8522^dedd4d41-cb53-11ed-b982-261f05e9ed63],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8522^dedd4d41-cb53-11ed-b982-261f05e9ed63,DevicePath:,},},Config:nil,},} Mar 25 21:28:16.664: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:28:16.674: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:28:16.685: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:27:37 +0000 UTC (0+7 container statuses recorded) Mar 25 21:28:16.685: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:28:16.685: INFO: netserver-1 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.685: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:16.685: INFO: e2e-net-exec started at 2023-03-25 21:28:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.685: INFO: Container e2e-net-exec ready: true, restart count 0 Mar 25 21:28:16.685: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:16.685: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:16.685: INFO: inline-volume-tester-gh7sx started at 2023-03-25 21:27:41 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.685: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:28:16.685: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:16.685: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:16.685: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:16.686: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:16.686: INFO: dns-test-9e62d3f5-8734-4efa-82aa-bac10651467e started at 2023-03-25 21:15:41 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:16.686: INFO: Container jessie-querier ready: false, restart count 6 Mar 25 21:28:16.686: INFO: Container querier ready: false, restart count 6 Mar 25 21:28:16.686: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:16.686: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.686: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:16.686: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:16.686: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:16.686: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:16.686: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:16.686: INFO: dns-test-105cc4fa-26dc-4534-a134-55e045d90aca started at 2023-03-25 21:17:53 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:16.686: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:28:16.686: INFO: Container querier ready: true, restart count 1 Mar 25 21:28:16.686: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:16.686: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.686: INFO: Container coredns ready: true, restart count 0 Mar 25 21:28:16.686: INFO: e2e-net-client started at 2023-03-25 21:28:11 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.686: INFO: Container e2e-net-client ready: true, restart count 0 Mar 25 21:28:16.897: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:28:16.898: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:28:16.902: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 35404 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:28:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:28:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-64c03214-fed9-4d1f-a1ba-2fdba563df7a kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-ccb66f4b-600f-4f9c-8331-f0a1a6c1d063 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-ad609723-3805-4e43-992e-74f8608460b3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-64c03214-fed9-4d1f-a1ba-2fdba563df7a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-ccb66f4b-600f-4f9c-8331-f0a1a6c1d063,DevicePath:,},},Config:nil,},} Mar 25 21:28:16.902: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:28:16.911: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:28:16.929: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:16.929: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:16.929: INFO: rs-z2zkc started at 2023-03-25 21:27:55 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container donothing ready: true, restart count 0 Mar 25 21:28:16.929: INFO: pod-subpath-test-dynamicpv-zr79 started at 2023-03-25 21:28:01 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:16.929: INFO: Container test-container-subpath-dynamicpv-zr79 ready: false, restart count 0 Mar 25 21:28:16.929: INFO: Container test-container-volume-dynamicpv-zr79 ready: true, restart count 0 Mar 25 21:28:16.929: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:16.929: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:16.929: INFO: netserver-2 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:16.929: INFO: ss2-1 started at 2023-03-25 21:27:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container webserver ready: false, restart count 0 Mar 25 21:28:16.929: INFO: liveness-8a3334e9-8ed9-4389-8512-aa18efce6b01 started at 2023-03-25 21:25:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container agnhost-container ready: false, restart count 4 Mar 25 21:28:16.929: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:16.929: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container querier ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:16.929: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:16.929: INFO: sample-webhook-deployment-6c69dbd86b-6k8pb started at 2023-03-25 21:27:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:28:16.929: INFO: ss-2 started at 2023-03-25 21:28:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container webserver ready: false, restart count 0 Mar 25 21:28:16.929: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:16.929: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:16.929: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container querier ready: true, restart count 0 Mar 25 21:28:16.929: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:16.929: INFO: update-demo-nautilus-wxf8x started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:28:16.929: INFO: inline-volume-tester2-7rkjv started at 2023-03-25 21:28:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:28:16.929: INFO: liveness-091ad6fe-b2c2-4b6b-876c-42be67f6167e started at 2023-03-25 21:25:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:16.929: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:28:17.127: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:28:17.127: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:28:17.133: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 35058 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9438":"csi-mock-csi-mock-volumes-9438","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:26:46 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-0719b742-fc61-4a05-b9e4-cda4aa5fe026 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-9220d80a-06c3-4156-ba01-584d48710fc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-9220d80a-06c3-4156-ba01-584d48710fc4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-0719b742-fc61-4a05-b9e4-cda4aa5fe026,DevicePath:,},},Config:nil,},} Mar 25 21:28:17.133: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:28:17.144: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:28:17.164: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:17.164: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:28:17.164: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container coredns ready: true, restart count 0 Mar 25 21:28:17.164: INFO: ss2-0 started at 2023-03-25 21:27:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:17.164: INFO: pod-exec-websocket-b80e2df6-91a9-42af-860a-3f42516642c0 started at 2023-03-25 21:27:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container main ready: true, restart count 0 Mar 25 21:28:17.164: INFO: pod-subpath-test-inlinevolume-5gjg started at 2023-03-25 21:28:10 +0000 UTC (2+2 container statuses recorded) Mar 25 21:28:17.164: INFO: Init container init-volume-inlinevolume-5gjg ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Init container test-init-subpath-inlinevolume-5gjg ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Container test-container-subpath-inlinevolume-5gjg ready: false, restart count 0 Mar 25 21:28:17.164: INFO: Container test-container-volume-inlinevolume-5gjg ready: false, restart count 0 Mar 25 21:28:17.164: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:17.164: INFO: netserver-3 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:17.164: INFO: agnhost-primary-kx64f started at 2023-03-25 21:27:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container agnhost-primary ready: false, restart count 0 Mar 25 21:28:17.164: INFO: ss-0 started at 2023-03-25 21:27:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:17.164: INFO: e2e-net-server started at 2023-03-25 21:28:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container e2e-net-server ready: true, restart count 0 Mar 25 21:28:17.164: INFO: hostexec-nodes-us-central1-c-wcck-f9hx4 started at 2023-03-25 21:28:14 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:28:17.164: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:17.164: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:17.164: INFO: csi-mockplugin-0 started at 2023-03-25 21:27:48 +0000 UTC (0+4 container statuses recorded) Mar 25 21:28:17.164: INFO: Container busybox ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Container csi-provisioner ready: false, restart count 1 Mar 25 21:28:17.164: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Container mock ready: true, restart count 0 Mar 25 21:28:17.164: INFO: inline-volume-tester-bwmp8 started at 2023-03-25 21:27:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.164: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:28:17.164: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:17.164: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:17.164: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:17.392: INFO: Latency metrics for node nodes-us-central1-c-wcck �[1mSTEP�[0m: Collecting events from namespace "webhook-8200-markers". �[1mSTEP�[0m: Found 0 events. Mar 25 21:28:17.402: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:28:17.402: INFO: Mar 25 21:28:17.410: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:28:17.415: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 29910 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:28:17.415: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:28:17.426: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:28:17.441: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:28:17.441: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:28:17.441: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:17.441: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:17.441: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:28:17.441: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:17.441: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.441: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:28:17.441: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.441: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:28:17.441: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:17.441: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:17.441: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:17.441: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.441: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:28:17.441: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.441: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:28:17.442: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:28:17.442: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:28:17.442: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:17.442: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:28:17.442: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:28:17.442: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.442: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:28:17.442: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.442: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:17.678: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:28:17.678: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:28:17.686: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 34752 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:27:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:27:57 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:27:55 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-3ee43c51-cad0-46e4-9d89-3b69174c8715],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-3ee43c51-cad0-46e4-9d89-3b69174c8715,DevicePath:,},},Config:nil,},} Mar 25 21:28:17.687: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:28:17.705: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:28:17.902: INFO: rs-xw54v started at 2023-03-25 21:27:55 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container donothing ready: true, restart count 0 Mar 25 21:28:17.902: INFO: exec-volume-test-preprovisionedpv-qhp4 started at <nil> (0+0 container statuses recorded) Mar 25 21:28:17.902: INFO: update-demo-nautilus-tbrmw started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:28:17.902: INFO: ss2-2 started at 2023-03-25 21:27:44 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:17.902: INFO: ss-1 started at 2023-03-25 21:27:46 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:17.902: INFO: pod-bb3c7aee-6869-463c-8530-c4fe1460a6d4 started at 2023-03-25 21:28:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container test-container ready: false, restart count 0 Mar 25 21:28:17.902: INFO: e2e-test-httpd-pod started at 2023-03-25 21:28:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container e2e-test-httpd-pod ready: false, restart count 0 Mar 25 21:28:17.902: INFO: successful-jobs-history-limit-27996328-z96z9 started at 2023-03-25 21:28:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container c ready: false, restart count 0 Mar 25 21:28:17.902: INFO: alpine-nnp-false-782ebc26-8d83-4f3a-9e10-5a2ae7356db4 started at 2023-03-25 21:27:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container alpine-nnp-false-782ebc26-8d83-4f3a-9e10-5a2ae7356db4 ready: false, restart count 0 Mar 25 21:28:17.902: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:17.902: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:17.902: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:17.902: INFO: e2e-test-httpd-pod started at 2023-03-25 21:28:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container e2e-test-httpd-pod ready: true, restart count 0 Mar 25 21:28:17.902: INFO: netserver-0 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:17.902: INFO: agnhost-primary-87thk started at 2023-03-25 21:27:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container agnhost-primary ready: false, restart count 0 Mar 25 21:28:17.902: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:17.902: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:17.902: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:17.902: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:17.902: INFO: hostexec-nodes-us-central1-c-h9x3-b9kfl started at 2023-03-25 21:28:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:28:17.902: INFO: failed-jobs-history-limit-27996328-jbz5x started at 2023-03-25 21:28:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.902: INFO: Container c ready: false, restart count 0 Mar 25 21:28:17.902: INFO: test-container-pod started at <nil> (0+0 container statuses recorded) Mar 25 21:28:17.902: INFO: host-test-container-pod started at <nil> (0+0 container statuses recorded) Mar 25 21:28:17.903: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:17.903: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:17.903: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:17.903: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:17.903: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:17.903: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:17.903: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:17.903: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:18.865: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:28:18.865: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:28:18.871: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 35039 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8522":"nodes-us-central1-c-lhrm","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:27:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:28:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8522^dedd4d41-cb53-11ed-b982-261f05e9ed63],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8522^dedd4d41-cb53-11ed-b982-261f05e9ed63,DevicePath:,},},Config:nil,},} Mar 25 21:28:18.871: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:28:18.892: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:28:18.909: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:18.909: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:18.910: INFO: inline-volume-tester-gh7sx started at 2023-03-25 21:27:41 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:18.910: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:28:18.910: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:18.910: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:18.910: INFO: dns-test-9e62d3f5-8734-4efa-82aa-bac10651467e started at 2023-03-25 21:15:41 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:18.910: INFO: Container jessie-querier ready: false, restart count 6 Mar 25 21:28:18.910: INFO: Container querier ready: false, restart count 6 Mar 25 21:28:18.910: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:18.910: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:18.910: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:18.910: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:18.910: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:18.910: INFO: dns-test-105cc4fa-26dc-4534-a134-55e045d90aca started at 2023-03-25 21:17:53 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:18.910: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container querier ready: true, restart count 1 Mar 25 21:28:18.910: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:18.910: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:18.910: INFO: Container coredns ready: true, restart count 0 Mar 25 21:28:18.910: INFO: e2e-net-client started at 2023-03-25 21:28:11 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:18.910: INFO: Container e2e-net-client ready: true, restart count 0 Mar 25 21:28:18.910: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:27:37 +0000 UTC (0+7 container statuses recorded) Mar 25 21:28:18.910: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:28:18.910: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:28:18.910: INFO: netserver-1 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:18.910: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:18.910: INFO: e2e-net-exec started at 2023-03-25 21:28:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:18.910: INFO: Container e2e-net-exec ready: true, restart count 0 Mar 25 21:28:19.103: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:28:19.103: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:28:19.157: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 35404 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:28:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:28:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:28:16 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-64c03214-fed9-4d1f-a1ba-2fdba563df7a kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-ccb66f4b-600f-4f9c-8331-f0a1a6c1d063 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-ad609723-3805-4e43-992e-74f8608460b3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-64c03214-fed9-4d1f-a1ba-2fdba563df7a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-ccb66f4b-600f-4f9c-8331-f0a1a6c1d063,DevicePath:,},},Config:nil,},} Mar 25 21:28:19.158: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:28:19.177: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:28:19.281: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:19.281: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:19.281: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container querier ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:19.281: INFO: update-demo-nautilus-wxf8x started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:28:19.281: INFO: inline-volume-tester2-7rkjv started at 2023-03-25 21:28:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:28:19.281: INFO: liveness-091ad6fe-b2c2-4b6b-876c-42be67f6167e started at 2023-03-25 21:25:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:28:19.281: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:19.281: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:19.281: INFO: simpletest.rc-h8psm started at 2023-03-25 21:28:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container nginx ready: false, restart count 0 Mar 25 21:28:19.281: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:19.281: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:19.281: INFO: netserver-2 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:19.281: INFO: ss2-1 started at 2023-03-25 21:27:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container webserver ready: false, restart count 0 Mar 25 21:28:19.281: INFO: liveness-8a3334e9-8ed9-4389-8512-aa18efce6b01 started at 2023-03-25 21:25:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container agnhost-container ready: false, restart count 4 Mar 25 21:28:19.281: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:28:19.281: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container querier ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:19.281: INFO: simpletest.rc-5rfbd started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.281: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:19.281: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:19.281: INFO: sample-webhook-deployment-6c69dbd86b-6k8pb started at 2023-03-25 21:27:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:28:19.281: INFO: ss-2 started at 2023-03-25 21:28:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.281: INFO: Container webserver ready: false, restart count 0 Mar 25 21:28:19.776: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:28:19.776: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:28:19.816: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 35058 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9438":"csi-mock-csi-mock-volumes-9438","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:26:46 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:28:05 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-0719b742-fc61-4a05-b9e4-cda4aa5fe026 kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-9220d80a-06c3-4156-ba01-584d48710fc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-9220d80a-06c3-4156-ba01-584d48710fc4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-0719b742-fc61-4a05-b9e4-cda4aa5fe026,DevicePath:,},},Config:nil,},} Mar 25 21:28:19.817: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:28:19.856: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:28:19.888: INFO: simpletest.rc-st27m started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.888: INFO: inline-volume-tester-bwmp8 started at 2023-03-25 21:27:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:28:19.888: INFO: simpletest.rc-fv854 started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.888: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:28:19.888: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:28:19.888: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:28:19.888: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:28:19.888: INFO: simpletest.rc-6bvf6 started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.888: INFO: simpletest.rc-xwr8t started at 2023-03-25 21:28:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container nginx ready: false, restart count 0 Mar 25 21:28:19.888: INFO: simpletest.rc-fjdbx started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.888: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:28:19.888: INFO: pod-aa9342f3-9ce3-4da5-bc65-32e193f3401b started at 2023-03-25 21:28:18 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:28:19.888: INFO: simpletest.rc-d6k4n started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.888: INFO: simpletest.rc-v4k78 started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.888: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:28:19.888: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container coredns ready: true, restart count 0 Mar 25 21:28:19.888: INFO: ss2-0 started at 2023-03-25 21:27:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:19.888: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:28:19.888: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:28:19.888: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:28:19.888: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:28:19.888: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:28:19.888: INFO: netserver-3 started at 2023-03-25 21:27:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:19.888: INFO: agnhost-primary-kx64f started at 2023-03-25 21:27:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container agnhost-primary ready: false, restart count 0 Mar 25 21:28:19.888: INFO: ss-0 started at 2023-03-25 21:27:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.888: INFO: Container webserver ready: true, restart count 0 Mar 25 21:28:19.889: INFO: e2e-net-server started at 2023-03-25 21:28:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.889: INFO: Container e2e-net-server ready: true, restart count 0 Mar 25 21:28:19.889: INFO: hostexec-nodes-us-central1-c-wcck-f9hx4 started at 2023-03-25 21:28:14 +0000 UTC (0+1 container statuses recorded) Mar 25 21:28:19.889: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:28:19.889: INFO: simpletest.rc-qmlvk started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.889: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:28:19.889: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:28:19.889: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:28:19.889: INFO: simpletest.rc-cbvrf started at <nil> (0+0 container statuses recorded) Mar 25 21:28:19.889: INFO: csi-mockplugin-0 started at 2023-03-25 21:27:48 +0000 UTC (0+4 container statuses recorded) Mar 25 21:28:19.889: INFO: Container busybox ready: true, restart count 0 Mar 25 21:28:19.889: INFO: Container csi-provisioner ready: false, restart count 1 Mar 25 21:28:19.889: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:28:19.889: INFO: Container mock ready: true, restart count 0 Mar 25 21:28:20.134: INFO: Latency metrics for node nodes-us-central1-c-wcck Mar 25 21:28:20.134: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "webhook-8200" for this suite. �[1mSTEP�[0m: Destroying namespace "webhook-8200-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\spod\sand\sconfigmap\screation\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:32:03.462: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00022e210>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:887from junit_15.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Mar 25 21:31:19.122: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Mar 25 21:31:19.868: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set �[1mSTEP�[0m: Deploying the webhook service �[1mSTEP�[0m: Verifying the service has paired with the endpoint Mar 25 21:31:22.963: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should be able to deny pod and configmap creation [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 �[1mSTEP�[0m: Registering the webhook via the AdmissionRegistration API Mar 25 21:31:22.989: INFO: Waiting for webhook configuration to be ready... Mar 25 21:31:23.130: INFO: Waiting for webhook configuration to be ready... Mar 25 21:31:33.214: INFO: Waiting for webhook configuration to be ready... Mar 25 21:31:43.335: INFO: Waiting for webhook configuration to be ready... Mar 25 21:31:53.414: INFO: Waiting for webhook configuration to be ready... Mar 25 21:32:03.461: INFO: Waiting for webhook configuration to be ready... Mar 25 21:32:03.462: FAIL: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00022e210>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerWebhook(0xc000cbc160, {0xc005e795e0, 0xc}, 0x0?, 0x0?) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:887 +0x5e5 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.4() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:195 +0x45 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24efc17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000aaa1a0, 0x72ee990) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "webhook-1769". �[1mSTEP�[0m: Found 6 events. Mar 25 21:32:03.469: INFO: At 2023-03-25 21:31:19 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-6c69dbd86b to 1 Mar 25 21:32:03.469: INFO: At 2023-03-25 21:31:19 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-6c69dbd86b-qrfqn Mar 25 21:32:03.469: INFO: At 2023-03-25 21:31:19 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-qrfqn: {default-scheduler } Scheduled: Successfully assigned webhook-1769/sample-webhook-deployment-6c69dbd86b-qrfqn to nodes-us-central1-c-lhrm Mar 25 21:32:03.469: INFO: At 2023-03-25 21:31:20 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-qrfqn: {kubelet nodes-us-central1-c-lhrm} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Mar 25 21:32:03.469: INFO: At 2023-03-25 21:31:20 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-qrfqn: {kubelet nodes-us-central1-c-lhrm} Created: Created container sample-webhook Mar 25 21:32:03.469: INFO: At 2023-03-25 21:31:21 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-qrfqn: {kubelet nodes-us-central1-c-lhrm} Started: Started container sample-webhook Mar 25 21:32:03.481: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:32:03.481: INFO: sample-webhook-deployment-6c69dbd86b-qrfqn nodes-us-central1-c-lhrm Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:31:19 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:31:21 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:31:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:31:19 +0000 UTC }] Mar 25 21:32:03.481: INFO: Mar 25 21:32:03.506: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:32:03.534: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 42887 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:32:03.534: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:32:03.547: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:32:03.580: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:32:03.580: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:03.580: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:03.580: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:32:03.580: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:03.580: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:32:03.580: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:32:03.580: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:03.580: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:32:03.580: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:32:03.580: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:03.580: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:32:03.580: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:03.580: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:03.580: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:32:03.580: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.580: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:32:03.824: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:32:03.824: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:32:03.830: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 44691 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-4568":"csi-mock-csi-mock-volumes-4568","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:34 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:31:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-4568^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-4568^4,DevicePath:,},},Config:nil,},} Mar 25 21:32:03.830: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:32:03.845: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:32:03.860: INFO: csi-mockplugin-resizer-0 started at 2023-03-25 21:31:06 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:32:03.860: INFO: hostexec-nodes-us-central1-c-h9x3-2fj7t started at 2023-03-25 21:31:44 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:03.860: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:03.860: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:03.860: INFO: pod-ephm-test-projected-gnpx started at 2023-03-25 21:31:13 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container test-container-subpath-projected-gnpx ready: false, restart count 0 Mar 25 21:32:03.860: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:03.860: INFO: csi-mockplugin-0 started at 2023-03-25 21:31:05 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:03.860: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container mock ready: true, restart count 0 Mar 25 21:32:03.860: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:03.860: INFO: pvc-volume-tester-n9bkb started at 2023-03-25 21:31:34 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container volume-tester ready: true, restart count 0 Mar 25 21:32:03.860: INFO: csi-mockplugin-0 started at 2023-03-25 21:30:58 +0000 UTC (0+4 container statuses recorded) Mar 25 21:32:03.860: INFO: Container busybox ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container csi-provisioner ready: false, restart count 1 Mar 25 21:32:03.860: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container mock ready: true, restart count 0 Mar 25 21:32:03.860: INFO: pod-ab3748ee-9490-4a19-beb6-494754506d92 started at 2023-03-25 21:31:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:32:03.860: INFO: busybox-43ef29c0-3898-4b4e-a647-769d1fa15dff started at 2023-03-25 21:31:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container busybox ready: true, restart count 0 Mar 25 21:32:03.860: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:03.860: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:03.860: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:03.860: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:32:03.860: INFO: pod-041e1b33-b0c2-4bba-9ea7-0f54d2984169 started at 2023-03-25 21:32:01 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:03.860: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:32:04.108: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:32:04.109: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:32:04.114: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 45115 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:14 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:dd6d57960dc104a4ee0fa7c58c6faa3e38725561af374c17f8cb905f7f73ba66 k8s.gcr.io/build-image/debian-iptables:bullseye-v1.1.0],SizeBytes:27059231,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-2f2bb96c-d2f2-4a6d-8253-650a38a2f432],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-2f2bb96c-d2f2-4a6d-8253-650a38a2f432,DevicePath:,},},Config:nil,},} Mar 25 21:32:04.115: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:32:04.125: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:32:04.137: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:04.137: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:04.137: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:04.137: INFO: dns-test-105cc4fa-26dc-4534-a134-55e045d90aca started at 2023-03-25 21:17:53 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:04.137: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:32:04.137: INFO: Container querier ready: true, restart count 1 Mar 25 21:32:04.137: INFO: Container webserver ready: true, restart count 0 Mar 25 21:32:04.137: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container coredns ready: true, restart count 0 Mar 25 21:32:04.137: INFO: hostexec-nodes-us-central1-c-lhrm-s44g5 started at 2023-03-25 21:31:44 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:04.137: INFO: local-injector started at 2023-03-25 21:31:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container local-injector ready: true, restart count 0 Mar 25 21:32:04.137: INFO: sample-webhook-deployment-6c69dbd86b-qrfqn started at 2023-03-25 21:31:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:32:04.137: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:04.137: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:04.137: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:04.137: INFO: pod-c843c677-254b-4dcf-b0bd-e86a85fae02c started at 2023-03-25 21:30:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:32:04.137: INFO: pod-client started at 2023-03-25 21:31:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container pod-client ready: true, restart count 0 Mar 25 21:32:04.137: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:31:21 +0000 UTC (0+7 container statuses recorded) Mar 25 21:32:04.137: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:32:04.137: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:32:04.137: INFO: test-webserver-03789235-6916-41a6-8c25-d26d5d7e114f started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.137: INFO: Container test-webserver ready: false, restart count 0 Mar 25 21:32:04.323: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:32:04.323: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:32:04.361: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 44876 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5098":"csi-mock-csi-mock-volumes-5098","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:32:04.362: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:32:04.382: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:32:04.418: INFO: pvc-volume-tester-ftvmw started at 2023-03-25 21:31:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Container volume-tester ready: true, restart count 0 Mar 25 21:32:04.419: INFO: startup-cf03f1b7-d575-4dc5-9d7a-cd83181c11b4 started at 2023-03-25 21:30:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Container busybox ready: false, restart count 0 Mar 25 21:32:04.419: INFO: csi-mockplugin-0 started at 2023-03-25 21:31:27 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:04.419: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container mock ready: true, restart count 0 Mar 25 21:32:04.419: INFO: hostexec-nodes-us-central1-c-n8lj-zzjcx started at 2023-03-25 21:31:34 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:04.419: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:04.419: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:04.419: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container querier ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container webserver ready: true, restart count 0 Mar 25 21:32:04.419: INFO: pod-subpath-test-preprovisionedpv-vxsz started at 2023-03-25 21:32:00 +0000 UTC (2+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Init container init-volume-preprovisionedpv-vxsz ready: false, restart count 0 Mar 25 21:32:04.419: INFO: Init container test-init-volume-preprovisionedpv-vxsz ready: false, restart count 0 Mar 25 21:32:04.419: INFO: Container test-container-subpath-preprovisionedpv-vxsz ready: false, restart count 0 Mar 25 21:32:04.419: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:04.419: INFO: hostexec-nodes-us-central1-c-n8lj-br6xz started at 2023-03-25 21:31:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:04.419: INFO: slow-terminating-unready-pod-nd7w8 started at 2023-03-25 21:28:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 25 21:32:04.419: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:04.419: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:04.419: INFO: pod-ad2e40e9-6904-4c2d-8d8b-e72357fe39cc started at 2023-03-25 21:32:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:04.419: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:32:04.419: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:04.419: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:04.419: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:04.419: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:32:04.419: INFO: Container querier ready: true, restart count 0 Mar 25 21:32:04.419: INFO: Container webserver ready: true, restart count 0 Mar 25 21:32:05.421: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:32:05.421: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:32:05.425: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 44967 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-760cb33a-813a-4184-89d6-78b748ffca16 kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-868273f5-02fb-4118-898c-c3cb0eddb074],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-868273f5-02fb-4118-898c-c3cb0eddb074,DevicePath:,},},Config:nil,},} Mar 25 21:32:05.425: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:32:05.438: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:32:05.474: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:05.475: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:05.475: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:05.475: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:05.475: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:05.475: INFO: inline-volume-tester-6n24n started at 2023-03-25 21:31:43 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:32:05.475: INFO: pod-terminate-status-1-0 started at <nil> (0+0 container statuses recorded) Mar 25 21:32:05.475: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:05.475: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:05.475: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:05.475: INFO: pod-server-2 started at 2023-03-25 21:31:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:05.475: INFO: hostexec-nodes-us-central1-c-wcck-tdp8m started at 2023-03-25 21:32:01 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:32:05.475: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:05.475: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:05.475: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:05.475: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:05.475: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) Mar 25 21:32:05.475: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:05.475: INFO: gcepd-injector started at 2023-03-25 21:31:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Container gcepd-injector ready: false, restart count 0 Mar 25 21:32:05.475: INFO: pod-terminate-status-2-0 started at <nil> (0+0 container statuses recorded) Mar 25 21:32:05.475: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:32:05.475: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.475: INFO: Container coredns ready: true, restart count 0 Mar 25 21:32:05.475: INFO: pod-terminate-status-0-0 started at <nil> (0+0 container statuses recorded) Mar 25 21:32:05.690: INFO: Latency metrics for node nodes-us-central1-c-wcck �[1mSTEP�[0m: Collecting events from namespace "webhook-1769-markers". �[1mSTEP�[0m: Found 0 events. Mar 25 21:32:05.709: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:32:05.709: INFO: Mar 25 21:32:05.714: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:32:05.722: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 42887 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:32:05.723: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:32:05.734: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:32:05.746: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.746: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:05.746: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.746: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:32:05.746: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:05.746: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:05.746: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:05.746: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:05.746: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:05.746: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:05.746: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.746: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:32:05.747: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.747: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:32:05.747: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:32:05.747: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:32:05.747: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:05.747: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:32:05.747: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.747: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:32:05.747: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.747: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:32:05.747: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:32:05.747: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:32:05.747: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:05.747: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:05.747: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:32:05.747: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:32:05.747: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:05.926: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:32:05.926: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:32:05.936: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 44691 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-4568":"csi-mock-csi-mock-volumes-4568","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:34 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:31:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:54 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-4568^4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-4568^4,DevicePath:,},},Config:nil,},} Mar 25 21:32:05.936: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:32:05.958: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:32:05.977: INFO: pod-041e1b33-b0c2-4bba-9ea7-0f54d2984169 started at 2023-03-25 21:32:01 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:32:05.977: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:05.977: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:05.977: INFO: csi-mockplugin-resizer-0 started at 2023-03-25 21:31:06 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:32:05.977: INFO: hostexec-nodes-us-central1-c-h9x3-2fj7t started at 2023-03-25 21:31:44 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:05.977: INFO: pod-ephm-test-projected-gnpx started at 2023-03-25 21:31:13 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container test-container-subpath-projected-gnpx ready: false, restart count 0 Mar 25 21:32:05.977: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:05.977: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:05.977: INFO: csi-mockplugin-0 started at 2023-03-25 21:31:05 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:05.977: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container mock ready: true, restart count 0 Mar 25 21:32:05.977: INFO: pvc-volume-tester-n9bkb started at 2023-03-25 21:31:34 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container volume-tester ready: true, restart count 0 Mar 25 21:32:05.977: INFO: csi-mockplugin-0 started at 2023-03-25 21:30:58 +0000 UTC (0+4 container statuses recorded) Mar 25 21:32:05.977: INFO: Container busybox ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container csi-provisioner ready: false, restart count 1 Mar 25 21:32:05.977: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container mock ready: true, restart count 0 Mar 25 21:32:05.977: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:05.977: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:05.977: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:05.977: INFO: busybox-43ef29c0-3898-4b4e-a647-769d1fa15dff started at 2023-03-25 21:31:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container busybox ready: true, restart count 0 Mar 25 21:32:05.977: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:05.977: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:32:06.170: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:32:06.170: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:32:06.185: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 45115 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:14 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:49 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:dd6d57960dc104a4ee0fa7c58c6faa3e38725561af374c17f8cb905f7f73ba66 k8s.gcr.io/build-image/debian-iptables:bullseye-v1.1.0],SizeBytes:27059231,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-2f2bb96c-d2f2-4a6d-8253-650a38a2f432],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-2f2bb96c-d2f2-4a6d-8253-650a38a2f432,DevicePath:,},},Config:nil,},} Mar 25 21:32:06.186: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:32:06.204: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:32:06.251: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:06.251: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:06.251: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:06.251: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:06.251: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:06.251: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:06.251: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:06.251: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:06.251: INFO: pod-c843c677-254b-4dcf-b0bd-e86a85fae02c started at 2023-03-25 21:30:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:32:06.251: INFO: pod-configmaps-64b72f20-d44c-424c-8006-9038528ba72a started at 2023-03-25 21:32:05 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:06.251: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:32:06.251: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Mar 25 21:32:06.251: INFO: pod-client started at 2023-03-25 21:31:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Container pod-client ready: true, restart count 0 Mar 25 21:32:06.251: INFO: test-webserver-03789235-6916-41a6-8c25-d26d5d7e114f started at 2023-03-25 21:31:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Container test-webserver ready: false, restart count 0 Mar 25 21:32:06.251: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:06.251: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:06.251: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:06.251: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:06.251: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:06.251: INFO: dns-test-105cc4fa-26dc-4534-a134-55e045d90aca started at 2023-03-25 21:17:53 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:06.251: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:32:06.251: INFO: Container querier ready: true, restart count 1 Mar 25 21:32:06.251: INFO: Container webserver ready: true, restart count 0 Mar 25 21:32:06.251: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Container coredns ready: true, restart count 0 Mar 25 21:32:06.251: INFO: hostexec-nodes-us-central1-c-lhrm-s44g5 started at 2023-03-25 21:31:44 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:06.251: INFO: sample-webhook-deployment-6c69dbd86b-qrfqn started at 2023-03-25 21:31:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.251: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:32:06.554: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:32:06.554: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:32:06.561: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 44876 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5098":"csi-mock-csi-mock-volumes-5098","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:42 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:32:06.561: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:32:06.578: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:32:06.599: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:06.599: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:32:06.599: INFO: Container querier ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container webserver ready: true, restart count 0 Mar 25 21:32:06.599: INFO: csi-mockplugin-0 started at 2023-03-25 21:31:27 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:06.599: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container mock ready: true, restart count 0 Mar 25 21:32:06.599: INFO: hostexec-nodes-us-central1-c-n8lj-zzjcx started at 2023-03-25 21:31:34 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:06.599: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:06.599: INFO: pvc-volume-tester-ftvmw started at 2023-03-25 21:31:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Container volume-tester ready: true, restart count 0 Mar 25 21:32:06.599: INFO: startup-cf03f1b7-d575-4dc5-9d7a-cd83181c11b4 started at 2023-03-25 21:30:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Container busybox ready: false, restart count 0 Mar 25 21:32:06.599: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:06.599: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:32:06.599: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container querier ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container webserver ready: true, restart count 0 Mar 25 21:32:06.599: INFO: pod-subpath-test-preprovisionedpv-vxsz started at 2023-03-25 21:32:00 +0000 UTC (2+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Init container init-volume-preprovisionedpv-vxsz ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Init container test-init-volume-preprovisionedpv-vxsz ready: false, restart count 0 Mar 25 21:32:06.599: INFO: Container test-container-subpath-preprovisionedpv-vxsz ready: false, restart count 0 Mar 25 21:32:06.599: INFO: hostexec-nodes-us-central1-c-n8lj-br6xz started at 2023-03-25 21:31:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:06.599: INFO: slow-terminating-unready-pod-nd7w8 started at 2023-03-25 21:28:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 25 21:32:06.599: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:06.599: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:06.599: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:06.599: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:06.599: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:06.599: INFO: pod-ad2e40e9-6904-4c2d-8d8b-e72357fe39cc started at 2023-03-25 21:32:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:06.599: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:32:07.431: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:32:07.431: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:32:07.435: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 44967 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:31:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:31:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:32:01 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-760cb33a-813a-4184-89d6-78b748ffca16 kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-868273f5-02fb-4118-898c-c3cb0eddb074],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-868273f5-02fb-4118-898c-c3cb0eddb074,DevicePath:,},},Config:nil,},} Mar 25 21:32:07.435: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:32:07.460: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:32:07.473: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:32:07.474: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:32:07.474: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:32:07.474: INFO: pod-server-2 started at 2023-03-25 21:31:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:32:07.474: INFO: hostexec-nodes-us-central1-c-wcck-tdp8m started at 2023-03-25 21:32:01 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:32:07.474: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:32:07.474: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:32:07.474: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:32:07.474: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:32:07.474: INFO: csi-hostpathplugin-0 started at <nil> (0+0 container statuses recorded) Mar 25 21:32:07.474: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:32:07.474: INFO: gcepd-injector started at 2023-03-25 21:31:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Container gcepd-injector ready: false, restart count 0 Mar 25 21:32:07.474: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:32:07.474: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Container coredns ready: true, restart count 0 Mar 25 21:32:07.474: INFO: pod-terminate-status-0-0 started at 2023-03-25 21:32:03 +0000 UTC (1+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Init container fail ready: false, restart count 0 Mar 25 21:32:07.474: INFO: Container blocked ready: false, restart count 0 Mar 25 21:32:07.474: INFO: pod-terminate-status-2-0 started at 2023-03-25 21:32:03 +0000 UTC (1+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Init container fail ready: false, restart count 0 Mar 25 21:32:07.474: INFO: Container blocked ready: false, restart count 0 Mar 25 21:32:07.474: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:32:07.474: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:32:07.474: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:32:07.474: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:32:07.474: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:32:07.474: INFO: inline-volume-tester-6n24n started at 2023-03-25 21:31:43 +0000 UTC (0+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Container csi-volume-tester ready: true, restart count 0 Mar 25 21:32:07.474: INFO: pod-terminate-status-1-0 started at 2023-03-25 21:32:03 +0000 UTC (1+1 container statuses recorded) Mar 25 21:32:07.474: INFO: Init container fail ready: false, restart count 0 Mar 25 21:32:07.474: INFO: Container blocked ready: false, restart count 0 Mar 25 21:32:07.631: INFO: Latency metrics for node nodes-us-central1-c-wcck Mar 25 21:32:07.632: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "webhook-1769" for this suite. �[1mSTEP�[0m: Destroying namespace "webhook-1769-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\shonor\stimeout\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:17:30.294: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00025e240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:2166from junit_05.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Mar 25 21:16:31.836: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Mar 25 21:16:32.545: INFO: new replicaset for deployment "sample-webhook-deployment" is yet to be created Mar 25 21:16:34.648: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Mar 25 21:16:36.695: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 16, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} �[1mSTEP�[0m: Deploying the webhook service �[1mSTEP�[0m: Verifying the service has paired with the endpoint Mar 25 21:16:39.699: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should honor timeout [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 �[1mSTEP�[0m: Setting timeout (1s) shorter than webhook latency (5s) �[1mSTEP�[0m: Registering slow webhook via the AdmissionRegistration API Mar 25 21:16:49.933: INFO: Waiting for webhook configuration to be ready... Mar 25 21:17:00.068: INFO: Waiting for webhook configuration to be ready... Mar 25 21:17:10.166: INFO: Waiting for webhook configuration to be ready... Mar 25 21:17:20.273: INFO: Waiting for webhook configuration to be ready... Mar 25 21:17:30.294: INFO: Waiting for webhook configuration to be ready... Mar 25 21:17:30.294: FAIL: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00025e240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerSlowWebhook(0xc0010ca000, {0xc0035c2380, 0xc}, 0xc002420d70, 0xc0005ff940, 0xc002d7b780, 0x0?) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:2166 +0x7c5 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.15() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:383 +0xd2 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24efc17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x24612d9?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc000d701a0, 0x72ee990) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "webhook-2428". �[1mSTEP�[0m: Found 6 events. Mar 25 21:17:30.298: INFO: At 2023-03-25 21:16:32 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-6c69dbd86b to 1 Mar 25 21:17:30.298: INFO: At 2023-03-25 21:16:32 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-6c69dbd86b-l56lh Mar 25 21:17:30.298: INFO: At 2023-03-25 21:16:32 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-l56lh: {default-scheduler } Scheduled: Successfully assigned webhook-2428/sample-webhook-deployment-6c69dbd86b-l56lh to nodes-us-central1-c-n8lj Mar 25 21:17:30.298: INFO: At 2023-03-25 21:16:34 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-l56lh: {kubelet nodes-us-central1-c-n8lj} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Mar 25 21:17:30.298: INFO: At 2023-03-25 21:16:34 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-l56lh: {kubelet nodes-us-central1-c-n8lj} Created: Created container sample-webhook Mar 25 21:17:30.298: INFO: At 2023-03-25 21:16:34 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-l56lh: {kubelet nodes-us-central1-c-n8lj} Started: Started container sample-webhook Mar 25 21:17:30.302: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:17:30.302: INFO: sample-webhook-deployment-6c69dbd86b-l56lh nodes-us-central1-c-n8lj Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:16:32 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:16:35 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:16:35 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:16:32 +0000 UTC }] Mar 25 21:17:30.302: INFO: Mar 25 21:17:30.315: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:17:30.323: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 2675 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:17:30.323: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:17:30.340: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:17:30.369: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:30.369: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:17:30.369: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:30.369: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:17:30.369: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:17:30.369: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:17:30.369: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:30.369: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:17:30.369: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:17:30.369: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:17:30.369: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:17:30.369: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:17:30.369: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:17:30.370: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:30.370: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:30.370: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:17:30.370: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:17:30.370: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:30.646: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:17:30.646: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:17:30.650: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 7721 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8412":"nodes-us-central1-c-h9x3","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:16:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:17:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-50dceef2-33aa-4cef-94fa-c2d649a825c0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-50dceef2-33aa-4cef-94fa-c2d649a825c0,DevicePath:,},},Config:nil,},} Mar 25 21:17:30.651: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:17:30.669: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:17:30.686: INFO: up-down-2-4k8kq started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.686: INFO: Container up-down-2 ready: true, restart count 0 Mar 25 21:17:30.686: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:17:22 +0000 UTC (0+7 container statuses recorded) Mar 25 21:17:30.686: INFO: Container csi-attacher ready: false, restart count 0 Mar 25 21:17:30.686: INFO: Container csi-provisioner ready: false, restart count 0 Mar 25 21:17:30.686: INFO: Container csi-resizer ready: false, restart count 0 Mar 25 21:17:30.686: INFO: Container csi-snapshotter ready: false, restart count 0 Mar 25 21:17:30.686: INFO: Container hostpath ready: false, restart count 0 Mar 25 21:17:30.686: INFO: Container liveness-probe ready: false, restart count 0 Mar 25 21:17:30.686: INFO: Container node-driver-registrar ready: false, restart count 0 Mar 25 21:17:30.686: INFO: test-rolling-update-with-lb-7dcdf997cd-4t8vs started at 2023-03-25 21:17:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.686: INFO: Container agnhost ready: true, restart count 0 Mar 25 21:17:30.686: INFO: up-down-1-wmnrl started at 2023-03-25 21:16:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.686: INFO: Container up-down-1 ready: true, restart count 0 Mar 25 21:17:30.686: INFO: hostexec-nodes-us-central1-c-h9x3-r6knv started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.686: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:30.686: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:30.686: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:30.686: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:30.686: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:30.686: INFO: adopt-release-zltng started at 2023-03-25 21:17:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.687: INFO: Container c ready: false, restart count 0 Mar 25 21:17:30.687: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:30.687: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:30.687: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:30.687: INFO: netserver-0 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.687: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:30.687: INFO: pod1 started at 2023-03-25 21:17:14 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.687: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:30.687: INFO: netserver-0 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.687: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:30.687: INFO: startup-f09900c8-1f6f-468e-a5a4-6ef021d69aa4 started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.687: INFO: Container busybox ready: false, restart count 0 Mar 25 21:17:30.687: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:30.687: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:30.687: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:30.687: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:30.687: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:30.687: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:30.687: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:30.687: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:30.687: INFO: pod-subpath-test-preprovisionedpv-wlss started at 2023-03-25 21:17:14 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:30.687: INFO: Container test-container-subpath-preprovisionedpv-wlss ready: false, restart count 0 Mar 25 21:17:30.687: INFO: Container test-container-volume-preprovisionedpv-wlss ready: true, restart count 0 Mar 25 21:17:31.152: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:17:31.152: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:17:31.156: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 5404 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:16:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:17:31.156: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:17:31.167: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:17:31.180: INFO: pod-42396ac9-b5ad-449d-b77b-547851193cda started at 2023-03-25 21:17:14 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:17:31.180: INFO: startup-script started at 2023-03-25 21:15:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container startup-script ready: true, restart count 0 Mar 25 21:17:31.180: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:31.180: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:31.180: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:31.180: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:31.180: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:31.180: INFO: netserver-1 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:31.180: INFO: up-down-1-7t2rd started at 2023-03-25 21:16:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container up-down-1 ready: true, restart count 0 Mar 25 21:17:31.180: INFO: hostexec-nodes-us-central1-c-lhrm-29pn6 started at 2023-03-25 21:17:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:31.180: INFO: pod-60a20700-8aeb-4944-8642-c729d426a1a8 started at 2023-03-25 21:17:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:17:31.180: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:31.180: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:31.180: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:31.180: INFO: hostexec-nodes-us-central1-c-lhrm-fmrbd started at 2023-03-25 21:16:55 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:31.180: INFO: pod-eb8835e2-ac98-4b79-a721-1fc83ad4d552 started at 2023-03-25 21:17:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:17:31.180: INFO: pod-607511e1-786e-4356-a9fc-60f52f855465 started at 2023-03-25 21:17:22 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:17:31.180: INFO: netserver-1 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:31.180: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:31.180: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:31.180: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:31.180: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:31.180: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:31.180: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container coredns ready: true, restart count 0 Mar 25 21:17:31.180: INFO: dns-test-9e62d3f5-8734-4efa-82aa-bac10651467e started at 2023-03-25 21:15:41 +0000 UTC (0+3 container statuses recorded) Mar 25 21:17:31.180: INFO: Container jessie-querier ready: false, restart count 1 Mar 25 21:17:31.180: INFO: Container querier ready: false, restart count 1 Mar 25 21:17:31.180: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:31.180: INFO: test-container-pod started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:31.180: INFO: pod-qos-class-55622bea-8666-4b90-87d6-7851d07bdd45 started at 2023-03-25 21:15:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.180: INFO: Container agnhost ready: false, restart count 0 Mar 25 21:17:31.692: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:17:31.692: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:17:31.700: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 7661 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:17:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:17:28 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-7bcab37a-783d-4694-b473-e765a8e25484],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-7bcab37a-783d-4694-b473-e765a8e25484,DevicePath:,},},Config:nil,},} Mar 25 21:17:31.700: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:17:31.722: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:17:31.736: INFO: ss-0 started at 2023-03-25 21:17:17 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:31.736: INFO: sample-webhook-deployment-6c69dbd86b-l56lh started at 2023-03-25 21:16:32 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:17:31.736: INFO: busybox-scheduling-e180bf91-db00-4700-b86e-71b2e03a6020 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:31.736: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:31.736: INFO: adopt-release-nm94h started at 2023-03-25 21:17:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container c ready: false, restart count 0 Mar 25 21:17:31.736: INFO: netserver-2 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:31.736: INFO: dns-test-60814206-3453-40ac-ac8d-9084d5e06a8b started at 2023-03-25 21:15:41 +0000 UTC (0+3 container statuses recorded) Mar 25 21:17:31.736: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container querier ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:31.736: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:17:31.736: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container querier ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:31.736: INFO: netserver-2 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:31.736: INFO: up-down-1-bf5q6 started at 2023-03-25 21:16:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container up-down-1 ready: true, restart count 0 Mar 25 21:17:31.736: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:31.736: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:31.736: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:31.736: INFO: hostexec-nodes-us-central1-c-n8lj-qgdnc started at <nil> (0+0 container statuses recorded) Mar 25 21:17:31.736: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:31.736: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:31.736: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:31.736: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:31.736: INFO: up-down-2-jbvp7 started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container up-down-2 ready: true, restart count 0 Mar 25 21:17:31.736: INFO: test-rolling-update-with-lb-7dcdf997cd-2cwcm started at 2023-03-25 21:17:20 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:31.736: INFO: Container agnhost ready: true, restart count 0 Mar 25 21:17:32.599: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:17:32.600: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:17:32.621: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 6028 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:16:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:17:32.621: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:17:32.642: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:17:32.667: INFO: up-down-2-xkvjl started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container up-down-2 ready: true, restart count 0 Mar 25 21:17:32.667: INFO: pod-ephm-test-projected-dhhs started at 2023-03-25 21:15:52 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container test-container-subpath-projected-dhhs ready: false, restart count 0 Mar 25 21:17:32.667: INFO: verify-service-up-host-exec-pod started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:32.667: INFO: test-rolling-update-with-lb-58c5c55949-jqgpf started at 2023-03-25 21:17:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container agnhost ready: true, restart count 0 Mar 25 21:17:32.667: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:32.667: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container coredns ready: true, restart count 0 Mar 25 21:17:32.667: INFO: netserver-3 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:32.667: INFO: webhook-to-be-mutated started at 2023-03-25 21:15:51 +0000 UTC (1+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Init container webhook-added-init-container ready: false, restart count 0 Mar 25 21:17:32.667: INFO: Container example ready: false, restart count 0 Mar 25 21:17:32.667: INFO: netserver-3 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:32.667: INFO: netserver-3 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:32.667: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:17:32.667: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:32.667: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:32.667: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:32.667: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:32.667: INFO: pod-ephm-test-projected-2q5z started at 2023-03-25 21:15:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container test-container-subpath-projected-2q5z ready: false, restart count 0 Mar 25 21:17:32.667: INFO: pod-terminate-status-1-6 started at 2023-03-25 21:17:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container fail ready: false, restart count 0 Mar 25 21:17:32.667: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:32.667: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:32.667: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:32.667: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:32.667: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:32.667: INFO: pod-terminate-status-2-9 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:32.667: INFO: pod-terminate-status-0-7 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:32.667: INFO: execpod8vg97 started at 2023-03-25 21:17:23 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:32.667: INFO: verify-service-up-exec-pod-mmw67 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:32.667: INFO: test-pod started at 2023-03-25 21:16:04 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:32.667: INFO: Container nginx ready: false, restart count 0 Mar 25 21:17:32.667: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:32.667: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:32.667: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:33.401: INFO: Latency metrics for node nodes-us-central1-c-wcck �[1mSTEP�[0m: Collecting events from namespace "webhook-2428-markers". �[1mSTEP�[0m: Found 0 events. Mar 25 21:17:33.439: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:17:33.439: INFO: Mar 25 21:17:33.451: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:17:33.464: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 2675 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:15:49 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:17:33.465: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:17:33.490: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:17:33.506: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:17:33.506: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:33.506: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.506: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:17:33.506: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:17:33.506: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:17:33.506: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:33.506: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:33.506: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:33.506: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.506: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:17:33.506: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.506: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:33.506: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.507: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:17:33.507: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:33.507: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:33.507: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.507: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:17:33.507: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.507: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:17:33.507: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:17:33.507: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:17:33.507: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:33.507: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:17:33.507: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:17:33.839: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:17:33.839: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:17:33.845: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 7721 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8412":"nodes-us-central1-c-h9x3","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:16:42 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:17:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:16:53 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-50dceef2-33aa-4cef-94fa-c2d649a825c0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-50dceef2-33aa-4cef-94fa-c2d649a825c0,DevicePath:,},},Config:nil,},} Mar 25 21:17:33.845: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:17:33.859: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:17:33.889: INFO: test-rolling-update-with-lb-58c5c55949-6xpvr started at 2023-03-25 21:17:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container agnhost ready: false, restart count 0 Mar 25 21:17:33.889: INFO: up-down-2-4k8kq started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container up-down-2 ready: true, restart count 0 Mar 25 21:17:33.889: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:17:22 +0000 UTC (0+7 container statuses recorded) Mar 25 21:17:33.889: INFO: Container csi-attacher ready: false, restart count 0 Mar 25 21:17:33.889: INFO: Container csi-provisioner ready: false, restart count 0 Mar 25 21:17:33.889: INFO: Container csi-resizer ready: false, restart count 0 Mar 25 21:17:33.889: INFO: Container csi-snapshotter ready: false, restart count 0 Mar 25 21:17:33.889: INFO: Container hostpath ready: false, restart count 0 Mar 25 21:17:33.889: INFO: Container liveness-probe ready: false, restart count 0 Mar 25 21:17:33.889: INFO: Container node-driver-registrar ready: false, restart count 0 Mar 25 21:17:33.889: INFO: test-rolling-update-with-lb-7dcdf997cd-4t8vs started at 2023-03-25 21:17:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container agnhost ready: true, restart count 0 Mar 25 21:17:33.889: INFO: up-down-1-wmnrl started at 2023-03-25 21:16:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container up-down-1 ready: true, restart count 0 Mar 25 21:17:33.889: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:33.889: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:33.889: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:33.889: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:33.889: INFO: hostexec-nodes-us-central1-c-h9x3-qwfcp started at <nil> (0+0 container statuses recorded) Mar 25 21:17:33.889: INFO: netserver-0 started at 2023-03-25 21:17:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:33.889: INFO: adopt-release-zltng started at 2023-03-25 21:17:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container c ready: true, restart count 0 Mar 25 21:17:33.889: INFO: deployment-shared-unset-c757c87b9-769pm started at <nil> (0+0 container statuses recorded) Mar 25 21:17:33.889: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:33.889: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:33.889: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:33.889: INFO: netserver-0 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:33.889: INFO: pod1 started at 2023-03-25 21:17:14 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:33.889: INFO: netserver-0 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:33.889: INFO: startup-f09900c8-1f6f-468e-a5a4-6ef021d69aa4 started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container busybox ready: false, restart count 0 Mar 25 21:17:33.889: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:33.889: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:33.889: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:33.889: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:33.889: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:33.889: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:33.889: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:34.335: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:17:34.335: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:17:34.352: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 5404 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:16:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:16:39 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:17:34.353: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:17:34.376: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:17:34.401: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:34.401: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:34.401: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:34.401: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:34.401: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:34.401: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:34.401: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.401: INFO: Container coredns ready: true, restart count 0 Mar 25 21:17:34.401: INFO: dns-test-9e62d3f5-8734-4efa-82aa-bac10651467e started at 2023-03-25 21:15:41 +0000 UTC (0+3 container statuses recorded) Mar 25 21:17:34.401: INFO: Container jessie-querier ready: false, restart count 1 Mar 25 21:17:34.401: INFO: Container querier ready: false, restart count 1 Mar 25 21:17:34.401: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:34.401: INFO: test-container-pod started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.401: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:34.401: INFO: pod-qos-class-55622bea-8666-4b90-87d6-7851d07bdd45 started at 2023-03-25 21:15:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.401: INFO: Container agnhost ready: false, restart count 0 Mar 25 21:17:34.401: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.401: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:34.401: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:34.401: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:34.401: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:34.401: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:34.401: INFO: netserver-1 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.401: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:34.402: INFO: up-down-1-7t2rd started at 2023-03-25 21:16:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.402: INFO: Container up-down-1 ready: true, restart count 0 Mar 25 21:17:34.402: INFO: hostexec-nodes-us-central1-c-lhrm-29pn6 started at 2023-03-25 21:17:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.402: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:34.402: INFO: pod-42396ac9-b5ad-449d-b77b-547851193cda started at 2023-03-25 21:17:14 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.402: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:17:34.402: INFO: startup-script started at 2023-03-25 21:15:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.402: INFO: Container startup-script ready: true, restart count 0 Mar 25 21:17:34.402: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:34.402: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:34.402: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:34.402: INFO: hostexec-nodes-us-central1-c-lhrm-fmrbd started at 2023-03-25 21:16:55 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.402: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:34.402: INFO: netserver-1 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.402: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:34.402: INFO: pod-60a20700-8aeb-4944-8642-c729d426a1a8 started at 2023-03-25 21:17:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.402: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:17:34.402: INFO: netserver-1 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:34.586: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:17:34.587: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:17:34.606: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 7661 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:17:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:17:28 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:17:25 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-7bcab37a-783d-4694-b473-e765a8e25484],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-7bcab37a-783d-4694-b473-e765a8e25484,DevicePath:,},},Config:nil,},} Mar 25 21:17:34.606: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:17:34.620: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:17:34.637: INFO: netserver-2 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:34.638: INFO: dns-test-60814206-3453-40ac-ac8d-9084d5e06a8b started at 2023-03-25 21:15:41 +0000 UTC (0+3 container statuses recorded) Mar 25 21:17:34.638: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container querier ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:34.638: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:17:34.638: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container querier ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:34.638: INFO: netserver-2 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:34.638: INFO: up-down-1-bf5q6 started at 2023-03-25 21:16:50 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container up-down-1 ready: true, restart count 0 Mar 25 21:17:34.638: INFO: adopt-release-nm94h started at 2023-03-25 21:17:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container c ready: true, restart count 0 Mar 25 21:17:34.638: INFO: ss2-0 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:34.638: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:34.638: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:34.638: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:34.638: INFO: hostexec-nodes-us-central1-c-n8lj-qgdnc started at 2023-03-25 21:17:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:17:34.638: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:34.638: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:34.638: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:34.638: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:34.638: INFO: up-down-2-jbvp7 started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container up-down-2 ready: true, restart count 0 Mar 25 21:17:34.638: INFO: test-rolling-update-with-lb-7dcdf997cd-2cwcm started at 2023-03-25 21:17:20 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container agnhost ready: true, restart count 0 Mar 25 21:17:34.638: INFO: sample-webhook-deployment-6c69dbd86b-l56lh started at 2023-03-25 21:16:32 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:17:34.638: INFO: busybox-scheduling-e180bf91-db00-4700-b86e-71b2e03a6020 started at 2023-03-25 21:17:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container busybox-scheduling-e180bf91-db00-4700-b86e-71b2e03a6020 ready: false, restart count 0 Mar 25 21:17:34.638: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:34.638: INFO: pod2 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:34.638: INFO: ss-0 started at 2023-03-25 21:17:17 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.638: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:34.948: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:17:34.948: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:17:34.951: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 6028 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:16:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:16:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:17:34.952: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:17:34.968: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:17:34.983: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:17:34.983: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:17:34.984: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:17:34.984: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:17:34.984: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:17:34.984: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:17:34.984: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:17:34.984: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:17:34.984: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:17:34.984: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:17:34.984: INFO: pod-ephm-test-projected-2q5z started at 2023-03-25 21:15:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container test-container-subpath-projected-2q5z ready: false, restart count 0 Mar 25 21:17:34.984: INFO: execpod8vg97 started at 2023-03-25 21:17:23 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:34.984: INFO: verify-service-up-exec-pod-mmw67 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:34.984: INFO: test-pod started at 2023-03-25 21:16:04 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container nginx ready: false, restart count 0 Mar 25 21:17:34.984: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:17:34.984: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:17:34.984: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:17:34.984: INFO: pod-terminate-status-2-9 started at 2023-03-25 21:17:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container fail ready: false, restart count 0 Mar 25 21:17:34.984: INFO: pod-terminate-status-0-7 started at 2023-03-25 21:17:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container fail ready: false, restart count 0 Mar 25 21:17:34.984: INFO: verify-service-up-host-exec-pod started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:17:34.984: INFO: test-rolling-update-with-lb-58c5c55949-jqgpf started at 2023-03-25 21:17:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container agnhost ready: true, restart count 0 Mar 25 21:17:34.984: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:17:34.984: INFO: up-down-2-xkvjl started at 2023-03-25 21:16:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container up-down-2 ready: true, restart count 0 Mar 25 21:17:34.984: INFO: pod-ephm-test-projected-dhhs started at 2023-03-25 21:15:52 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container test-container-subpath-projected-dhhs ready: false, restart count 0 Mar 25 21:17:34.984: INFO: webhook-to-be-mutated started at 2023-03-25 21:15:51 +0000 UTC (1+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Init container webhook-added-init-container ready: false, restart count 0 Mar 25 21:17:34.984: INFO: Container example ready: false, restart count 0 Mar 25 21:17:34.984: INFO: netserver-3 started at 2023-03-25 21:16:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container webserver ready: true, restart count 0 Mar 25 21:17:34.984: INFO: netserver-3 started at 2023-03-25 21:17:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container webserver ready: false, restart count 0 Mar 25 21:17:34.984: INFO: pod-terminate-status-1-7 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:34.984: INFO: pod-secrets-23e23dae-c744-4d4b-8ce4-8ce18733df2f started at <nil> (0+0 container statuses recorded) Mar 25 21:17:34.984: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:17:34.984: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:17:34.984: INFO: Container coredns ready: true, restart count 0 Mar 25 21:17:34.984: INFO: netserver-3 started at <nil> (0+0 container statuses recorded) Mar 25 21:17:35.118: INFO: Latency metrics for node nodes-us-central1-c-wcck Mar 25 21:17:35.118: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "webhook-2428" for this suite. �[1mSTEP�[0m: Destroying namespace "webhook-2428-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\smutate\scustom\sresource\swith\spruning\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:33:32.156: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00025e240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1804from junit_21.xml
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Mar 25 21:32:31.217: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Mar 25 21:32:32.077: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Mar 25 21:32:34.143: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Mar 25 21:32:36.149: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Mar 25 21:32:38.150: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 32, 32, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} �[1mSTEP�[0m: Deploying the webhook service �[1mSTEP�[0m: Verifying the service has paired with the endpoint Mar 25 21:32:41.187: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should mutate custom resource with pruning [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:32:41.191: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Registering the mutating webhook for custom resource e2e-test-webhook-2618-crds.webhook.example.com via the AdmissionRegistration API Mar 25 21:32:51.732: INFO: Waiting for webhook configuration to be ready... Mar 25 21:33:01.855: INFO: Waiting for webhook configuration to be ready... Mar 25 21:33:12.016: INFO: Waiting for webhook configuration to be ready... Mar 25 21:33:22.052: INFO: Waiting for webhook configuration to be ready... Mar 25 21:33:32.156: INFO: Waiting for webhook configuration to be ready... Mar 25 21:33:32.156: FAIL: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc00025e240>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerMutatingWebhookForCustomResource(0xc000b471e0, {0xc002c80980, 0xc}, 0xc002cd61e0, 0xc0022338a0, 0x0?) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1804 +0xd25 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.14() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:364 +0xdc k8s.io/kubernetes/test/e2e.RunE2ETests(0x24efc17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0x0?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0002a4820, 0x72ee990) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "webhook-4485". �[1mSTEP�[0m: Found 6 events. Mar 25 21:33:32.795: INFO: At 2023-03-25 21:32:32 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-6c69dbd86b to 1 Mar 25 21:33:32.795: INFO: At 2023-03-25 21:32:32 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-6c69dbd86b-w5rwb Mar 25 21:33:32.795: INFO: At 2023-03-25 21:32:32 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-w5rwb: {default-scheduler } Scheduled: Successfully assigned webhook-4485/sample-webhook-deployment-6c69dbd86b-w5rwb to nodes-us-central1-c-lhrm Mar 25 21:33:32.795: INFO: At 2023-03-25 21:32:33 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-w5rwb: {kubelet nodes-us-central1-c-lhrm} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Mar 25 21:33:32.795: INFO: At 2023-03-25 21:32:33 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-w5rwb: {kubelet nodes-us-central1-c-lhrm} Created: Created container sample-webhook Mar 25 21:33:32.795: INFO: At 2023-03-25 21:32:34 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-w5rwb: {kubelet nodes-us-central1-c-lhrm} Started: Started container sample-webhook Mar 25 21:33:32.846: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:33:32.846: INFO: sample-webhook-deployment-6c69dbd86b-w5rwb nodes-us-central1-c-lhrm Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:32:32 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:32:34 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:32:34 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:32:32 +0000 UTC }] Mar 25 21:33:32.846: INFO: Mar 25 21:33:32.918: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:33:32.925: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 42887 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:32.926: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:33:32.940: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:33:32.974: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:33:32.974: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:33:32.974: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:32.974: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:33:32.974: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:33:32.974: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:32.974: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:33:32.974: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:32.974: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:33:32.974: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:33:32.974: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:32.974: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:32.974: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:33:32.974: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:33:32.974: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:32.974: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:32.974: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:33:33.307: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:33:33.307: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:33:33.337: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 47837 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:33:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:33:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:06 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:06 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:06 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:33:06 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-6844dadc-666b-486d-a043-0dc06cf93bae],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-6844dadc-666b-486d-a043-0dc06cf93bae,DevicePath:,},},Config:nil,},} Mar 25 21:33:33.338: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:33:33.361: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:33:33.480: INFO: service-headless-p87c4 started at 2023-03-25 21:33:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.480: INFO: Container service-headless ready: true, restart count 0 Mar 25 21:33:33.480: INFO: hostexec-nodes-us-central1-c-h9x3-4w2z6 started at 2023-03-25 21:33:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.480: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:33.480: INFO: client-containers-7cf6c28e-a894-4e2f-a13f-656cf402e566 started at 2023-03-25 21:33:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.480: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:33:33.480: INFO: affinity-clusterip-timeout-mv8wq started at 2023-03-25 21:33:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.480: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 Mar 25 21:33:33.481: INFO: service-headless-toggled-99vb9 started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container service-headless-toggled ready: false, restart count 0 Mar 25 21:33:33.481: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:33.481: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:33.481: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:33.481: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:33.481: INFO: pod-terminate-status-2-11 started at <nil> (0+0 container statuses recorded) Mar 25 21:33:33.481: INFO: externalname-service-pd2f5 started at 2023-03-25 21:33:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container externalname-service ready: true, restart count 0 Mar 25 21:33:33.481: INFO: deployment-8d545c96d-cx9kc started at 2023-03-25 21:32:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container nginx ready: false, restart count 0 Mar 25 21:33:33.481: INFO: metadata-volume-af00d81d-d439-4d7f-b4dd-e5f9d44210ae started at 2023-03-25 21:33:18 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container client-container ready: false, restart count 0 Mar 25 21:33:33.481: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:33.481: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:33.481: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:33.481: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:33.481: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:33.481: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:33.481: INFO: pod-9cfb91c4-6310-4778-bb31-a83c1e2ffd7b started at <nil> (0+0 container statuses recorded) Mar 25 21:33:33.481: INFO: gcepd-injector started at 2023-03-25 21:32:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container gcepd-injector ready: true, restart count 0 Mar 25 21:33:33.481: INFO: pod-terminate-status-1-11 started at 2023-03-25 21:33:17 +0000 UTC (1+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Init container fail ready: false, restart count 0 Mar 25 21:33:33.481: INFO: Container blocked ready: false, restart count 0 Mar 25 21:33:33.481: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:33.481: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:33.481: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:33.481: INFO: webserver-pod started at 2023-03-25 21:32:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container agnhost ready: false, restart count 0 Mar 25 21:33:33.481: INFO: pvc-volume-tester-writer-xjt2x started at 2023-03-25 21:33:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:33.481: INFO: Container volume-tester ready: false, restart count 0 Mar 25 21:33:35.576: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:33:35.576: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:33:35.593: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 48714 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:33:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:dd6d57960dc104a4ee0fa7c58c6faa3e38725561af374c17f8cb905f7f73ba66 k8s.gcr.io/build-image/debian-iptables:bullseye-v1.1.0],SizeBytes:27059231,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:35.593: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:33:35.625: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:33:35.651: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:35.651: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:35.651: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:35.651: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:35.651: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:35.651: INFO: pod-0 started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container donothing ready: true, restart count 0 Mar 25 21:33:35.651: INFO: pod-1 started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container donothing ready: true, restart count 0 Mar 25 21:33:35.651: INFO: service-headless-nv6fw started at 2023-03-25 21:33:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container service-headless ready: true, restart count 0 Mar 25 21:33:35.651: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:35.651: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:35.651: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:35.651: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:35.651: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:35.651: INFO: sample-webhook-deployment-6c69dbd86b-w5rwb started at 2023-03-25 21:32:32 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:33:35.651: INFO: pod-terminate-status-0-12 started at 2023-03-25 21:33:31 +0000 UTC (1+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Init container fail ready: false, restart count 0 Mar 25 21:33:35.651: INFO: Container blocked ready: false, restart count 0 Mar 25 21:33:35.651: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container coredns ready: true, restart count 0 Mar 25 21:33:35.651: INFO: affinity-clusterip-timeout-c55mb started at 2023-03-25 21:33:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 25 21:33:35.651: INFO: pod-init-dd6542d8-22ea-475f-bfec-7f6fb20aa053 started at 2023-03-25 21:32:41 +0000 UTC (2+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Init container init1 ready: false, restart count 3 Mar 25 21:33:35.651: INFO: Init container init2 ready: false, restart count 0 Mar 25 21:33:35.651: INFO: Container run1 ready: false, restart count 0 Mar 25 21:33:35.651: INFO: dns-test-97bdcb7e-4323-4eb3-81bc-7744eaa3733f started at 2023-03-25 21:33:32 +0000 UTC (0+3 container statuses recorded) Mar 25 21:33:35.651: INFO: Container jessie-querier ready: false, restart count 0 Mar 25 21:33:35.651: INFO: Container querier ready: false, restart count 0 Mar 25 21:33:35.651: INFO: Container webserver ready: false, restart count 0 Mar 25 21:33:35.651: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:35.651: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:35.651: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:35.651: INFO: service-headless-toggled-nfpdl started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 25 21:33:35.651: INFO: externalname-service-8m9lx started at 2023-03-25 21:33:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.651: INFO: Container externalname-service ready: true, restart count 0 Mar 25 21:33:35.910: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:33:35.911: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:33:35.917: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 47479 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:32:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:35.917: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:33:35.933: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:33:35.949: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:35.949: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:33:35.949: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Container querier ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Container webserver ready: true, restart count 0 Mar 25 21:33:35.949: INFO: hostexec-nodes-us-central1-c-n8lj-hjmhn started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:35.949: INFO: hostexec-nodes-us-central1-c-n8lj-br6xz started at 2023-03-25 21:31:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:35.949: INFO: slow-terminating-unready-pod-nd7w8 started at 2023-03-25 21:28:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 25 21:33:35.949: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:35.949: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:35.949: INFO: my-hostname-basic-3e47a66e-a398-4fab-8788-13b187a4dc98-rp749 started at 2023-03-25 21:32:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Container my-hostname-basic-3e47a66e-a398-4fab-8788-13b187a4dc98 ready: true, restart count 0 Mar 25 21:33:35.949: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:35.949: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:35.949: INFO: pod-ad2e40e9-6904-4c2d-8d8b-e72357fe39cc started at 2023-03-25 21:32:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:33:35.949: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:33:35.949: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:33:35.949: INFO: Container querier ready: true, restart count 1 Mar 25 21:33:35.949: INFO: Container webserver ready: true, restart count 0 Mar 25 21:33:35.949: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:35.949: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:35.949: INFO: startup-cf03f1b7-d575-4dc5-9d7a-cd83181c11b4 started at 2023-03-25 21:30:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:35.949: INFO: Container busybox ready: false, restart count 0 Mar 25 21:33:36.140: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:33:36.140: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:33:36.155: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 48773 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:36.156: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:33:36.176: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:33:36.192: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:36.192: INFO: service-headless-toggled-rttbg started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 25 21:33:36.192: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:33:36.192: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container coredns ready: true, restart count 0 Mar 25 21:33:36.192: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:36.192: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:36.192: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:36.192: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:36.192: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:36.192: INFO: affinity-clusterip-timeout-76599 started at 2023-03-25 21:33:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 25 21:33:36.192: INFO: exec-volume-test-preprovisionedpv-2mmz started at 2023-03-25 21:33:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container exec-container-preprovisionedpv-2mmz ready: false, restart count 0 Mar 25 21:33:36.192: INFO: image-pull-teste3da5c62-593a-4054-af13-4c731e3f5206 started at <nil> (0+0 container statuses recorded) Mar 25 21:33:36.192: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:36.192: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:36.192: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:36.192: INFO: liveness-f2c60575-f39b-48f3-94ae-cef9feffa0bf started at 2023-03-25 21:33:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:36.192: INFO: hostexec-nodes-us-central1-c-wcck-w2hk9 started at 2023-03-25 21:33:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:36.192: INFO: pod-terminate-status-1-12 started at 2023-03-25 21:33:35 +0000 UTC (1+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Init container fail ready: false, restart count 0 Mar 25 21:33:36.192: INFO: Container blocked ready: false, restart count 0 Mar 25 21:33:36.192: INFO: pod-terminate-status-0-13 started at <nil> (0+0 container statuses recorded) Mar 25 21:33:36.192: INFO: hostexec-nodes-us-central1-c-wcck-8bt97 started at 2023-03-25 21:33:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:36.192: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:36.192: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:36.192: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:36.192: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:36.192: INFO: pod-should-be-evicted98b1077a-4b6a-4558-947c-419df159dc07 started at 2023-03-25 21:33:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container bar ready: false, restart count 0 Mar 25 21:33:36.192: INFO: service-headless-b4rl7 started at 2023-03-25 21:33:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:36.192: INFO: Container service-headless ready: true, restart count 0 Mar 25 21:33:37.484: INFO: Latency metrics for node nodes-us-central1-c-wcck �[1mSTEP�[0m: Collecting events from namespace "webhook-4485-markers". �[1mSTEP�[0m: Found 0 events. Mar 25 21:33:37.586: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:33:37.586: INFO: Mar 25 21:33:37.609: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:33:37.640: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 42887 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:31:10 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:37.640: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:33:37.664: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:33:37.688: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:33:37.688: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:33:37.688: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:37.688: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:37.688: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:37.688: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:33:37.689: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:37.689: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:33:37.689: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:33:37.689: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:33:37.689: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:33:37.689: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:37.689: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:33:37.689: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:33:37.689: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:37.689: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:33:37.689: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:37.689: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:37.689: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:38.073: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:33:38.073: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:33:38.085: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 49008 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:33:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:33:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:38 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:33:38 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-1d96c982-7c3b-4a3d-906c-b8f3b107d728],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-6844dadc-666b-486d-a043-0dc06cf93bae,DevicePath:,},},Config:nil,},} Mar 25 21:33:38.085: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:33:38.103: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:33:38.245: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:38.245: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:38.245: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:38.245: INFO: webserver-pod started at 2023-03-25 21:32:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.245: INFO: Container agnhost ready: false, restart count 0 Mar 25 21:33:38.245: INFO: pvc-volume-tester-writer-xjt2x started at 2023-03-25 21:33:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.245: INFO: Container volume-tester ready: false, restart count 0 Mar 25 21:33:38.245: INFO: service-headless-p87c4 started at 2023-03-25 21:33:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.245: INFO: Container service-headless ready: true, restart count 0 Mar 25 21:33:38.245: INFO: hostexec-nodes-us-central1-c-h9x3-4w2z6 started at 2023-03-25 21:33:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.245: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:38.245: INFO: client-containers-7cf6c28e-a894-4e2f-a13f-656cf402e566 started at 2023-03-25 21:33:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:33:38.246: INFO: affinity-clusterip-timeout-mv8wq started at 2023-03-25 21:33:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 25 21:33:38.246: INFO: service-headless-toggled-99vb9 started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 25 21:33:38.246: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:38.246: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:38.246: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:38.246: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:38.246: INFO: metadata-volume-af00d81d-d439-4d7f-b4dd-e5f9d44210ae started at 2023-03-25 21:33:18 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container client-container ready: false, restart count 0 Mar 25 21:33:38.246: INFO: pod-terminate-status-2-11 started at 2023-03-25 21:33:32 +0000 UTC (1+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Init container fail ready: false, restart count 0 Mar 25 21:33:38.246: INFO: Container blocked ready: false, restart count 0 Mar 25 21:33:38.246: INFO: externalname-service-pd2f5 started at 2023-03-25 21:33:05 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container externalname-service ready: true, restart count 0 Mar 25 21:33:38.246: INFO: deployment-8d545c96d-cx9kc started at 2023-03-25 21:32:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container nginx ready: false, restart count 0 Mar 25 21:33:38.246: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:38.246: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:38.246: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:38.246: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:38.246: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:38.246: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:38.246: INFO: pod-9cfb91c4-6310-4778-bb31-a83c1e2ffd7b started at 2023-03-25 21:33:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:38.246: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:33:38.995: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:33:38.995: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:33:39.007: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 48714 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:33:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:33:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/build-image/debian-iptables@sha256:dd6d57960dc104a4ee0fa7c58c6faa3e38725561af374c17f8cb905f7f73ba66 k8s.gcr.io/build-image/debian-iptables:bullseye-v1.1.0],SizeBytes:27059231,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:39.008: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:33:39.034: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:33:39.049: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container coredns ready: true, restart count 0 Mar 25 21:33:39.049: INFO: affinity-clusterip-timeout-c55mb started at 2023-03-25 21:33:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 25 21:33:39.049: INFO: pod-init-dd6542d8-22ea-475f-bfec-7f6fb20aa053 started at 2023-03-25 21:32:41 +0000 UTC (2+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Init container init1 ready: false, restart count 3 Mar 25 21:33:39.049: INFO: Init container init2 ready: false, restart count 0 Mar 25 21:33:39.049: INFO: Container run1 ready: false, restart count 0 Mar 25 21:33:39.049: INFO: dns-test-97bdcb7e-4323-4eb3-81bc-7744eaa3733f started at 2023-03-25 21:33:32 +0000 UTC (0+3 container statuses recorded) Mar 25 21:33:39.049: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Container querier ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Container webserver ready: true, restart count 0 Mar 25 21:33:39.049: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:39.049: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:39.049: INFO: service-headless-toggled-nfpdl started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 25 21:33:39.049: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:39.049: INFO: pod-0 started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container donothing ready: true, restart count 0 Mar 25 21:33:39.049: INFO: gcepd-client started at 2023-03-25 21:33:38 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container gcepd-client ready: false, restart count 0 Mar 25 21:33:39.049: INFO: service-headless-nv6fw started at 2023-03-25 21:33:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container service-headless ready: true, restart count 0 Mar 25 21:33:39.049: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:39.049: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:39.049: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:39.049: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:39.049: INFO: sample-webhook-deployment-6c69dbd86b-w5rwb started at 2023-03-25 21:32:32 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.049: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:33:39.228: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:33:39.228: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:33:39.237: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 49043 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-587":"nodes-us-central1-c-n8lj","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:32:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:32:54 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nautilus@sha256:99c0d6f1ad24a1aa1905d9c6534d193f268f7b23f9add2ae6bb41f31094bdd5c k8s.gcr.io/e2e-test-images/nautilus:1.5],SizeBytes:49642095,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:39.237: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:33:39.265: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:33:39.291: INFO: hostexec-nodes-us-central1-c-n8lj-br6xz started at 2023-03-25 21:31:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:39.291: INFO: slow-terminating-unready-pod-nd7w8 started at 2023-03-25 21:28:56 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container slow-terminating-unready-pod ready: false, restart count 0 Mar 25 21:33:39.291: INFO: my-hostname-basic-3e47a66e-a398-4fab-8788-13b187a4dc98-rp749 started at 2023-03-25 21:32:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container my-hostname-basic-3e47a66e-a398-4fab-8788-13b187a4dc98 ready: true, restart count 0 Mar 25 21:33:39.291: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:33:36 +0000 UTC (0+7 container statuses recorded) Mar 25 21:33:39.291: INFO: Container csi-attacher ready: false, restart count 0 Mar 25 21:33:39.291: INFO: Container csi-provisioner ready: false, restart count 0 Mar 25 21:33:39.291: INFO: Container csi-resizer ready: false, restart count 0 Mar 25 21:33:39.291: INFO: Container csi-snapshotter ready: false, restart count 0 Mar 25 21:33:39.291: INFO: Container hostpath ready: false, restart count 0 Mar 25 21:33:39.291: INFO: Container liveness-probe ready: false, restart count 0 Mar 25 21:33:39.291: INFO: Container node-driver-registrar ready: false, restart count 0 Mar 25 21:33:39.291: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:39.291: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:39.291: INFO: pod-ad2e40e9-6904-4c2d-8d8b-e72357fe39cc started at 2023-03-25 21:32:00 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container write-pod ready: true, restart count 0 Mar 25 21:33:39.291: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:39.291: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:39.291: INFO: inline-volume-tester-79gjw started at 2023-03-25 21:33:36 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container csi-volume-tester ready: false, restart count 0 Mar 25 21:33:39.291: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:33:39.291: INFO: Container jessie-querier ready: true, restart count 1 Mar 25 21:33:39.291: INFO: Container querier ready: true, restart count 1 Mar 25 21:33:39.291: INFO: Container webserver ready: true, restart count 0 Mar 25 21:33:39.291: INFO: startup-cf03f1b7-d575-4dc5-9d7a-cd83181c11b4 started at 2023-03-25 21:30:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container busybox ready: false, restart count 0 Mar 25 21:33:39.291: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:39.291: INFO: dns-test-be4a8849-a808-471e-8adc-8cd5477297a2 started at 2023-03-25 21:27:48 +0000 UTC (0+3 container statuses recorded) Mar 25 21:33:39.291: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Container querier ready: true, restart count 0 Mar 25 21:33:39.291: INFO: Container webserver ready: true, restart count 0 Mar 25 21:33:39.291: INFO: hostexec-nodes-us-central1-c-n8lj-hjmhn started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:39.291: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.291: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:39.585: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:33:39.585: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:33:39.600: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 48773 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:33:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:33:33 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:33:39.601: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:33:39.624: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:33:39.653: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:33:39.653: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:33:39.654: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:33:39.654: INFO: liveness-f2c60575-f39b-48f3-94ae-cef9feffa0bf started at 2023-03-25 21:33:19 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:39.654: INFO: hostexec-nodes-us-central1-c-wcck-w2hk9 started at 2023-03-25 21:33:26 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:39.654: INFO: pod-terminate-status-1-12 started at 2023-03-25 21:33:35 +0000 UTC (1+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Init container fail ready: false, restart count 0 Mar 25 21:33:39.654: INFO: Container blocked ready: false, restart count 0 Mar 25 21:33:39.654: INFO: verify-service-up-host-exec-pod started at 2023-03-25 21:33:36 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container agnhost-container ready: false, restart count 0 Mar 25 21:33:39.654: INFO: pod-terminate-status-0-13 started at 2023-03-25 21:33:36 +0000 UTC (1+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Init container fail ready: false, restart count 0 Mar 25 21:33:39.654: INFO: Container blocked ready: false, restart count 0 Mar 25 21:33:39.654: INFO: hostexec-nodes-us-central1-c-wcck-8bt97 started at 2023-03-25 21:33:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:33:39.654: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:33:39.654: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:33:39.654: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:33:39.654: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:33:39.654: INFO: pod-should-be-evicted98b1077a-4b6a-4558-947c-419df159dc07 started at 2023-03-25 21:33:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container bar ready: false, restart count 0 Mar 25 21:33:39.654: INFO: service-headless-b4rl7 started at 2023-03-25 21:33:15 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container service-headless ready: true, restart count 0 Mar 25 21:33:39.654: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:33:39.654: INFO: service-headless-toggled-rttbg started at 2023-03-25 21:33:27 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container service-headless-toggled ready: true, restart count 0 Mar 25 21:33:39.654: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:33:39.654: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container coredns ready: true, restart count 0 Mar 25 21:33:39.654: INFO: execpod-affinityhwbgz started at <nil> (0+0 container statuses recorded) Mar 25 21:33:39.654: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:33:39.654: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:33:39.654: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:33:39.654: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:33:39.654: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:33:39.654: INFO: affinity-clusterip-timeout-76599 started at 2023-03-25 21:33:25 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Mar 25 21:33:39.654: INFO: image-pull-teste3da5c62-593a-4054-af13-4c731e3f5206 started at 2023-03-25 21:33:35 +0000 UTC (0+1 container statuses recorded) Mar 25 21:33:39.654: INFO: Container image-pull-test ready: false, restart count 0 Mar 25 21:33:39.941: INFO: Latency metrics for node nodes-us-central1-c-wcck Mar 25 21:33:39.941: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready �[1mSTEP�[0m: Destroying namespace "webhook-4485" for this suite. �[1mSTEP�[0m: Destroying namespace "webhook-4485-markers" for this suite. [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:102
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sunconditionally\sreject\soperations\son\sfail\sclosed\swebhook\s\[Conformance\]$'
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 Mar 25 21:27:08.249: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc000230230>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1253
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185 �[1mSTEP�[0m: Creating a kubernetes client Mar 25 21:26:10.046: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP�[0m: Building a namespace api object, basename webhook �[1mSTEP�[0m: Waiting for a default service account to be provisioned in namespace �[1mSTEP�[0m: Waiting for kube-root-ca.crt to be provisioned in namespace [BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:87 �[1mSTEP�[0m: Setting up server cert �[1mSTEP�[0m: Create role binding to let webhook read extension-apiserver-authentication �[1mSTEP�[0m: Deploying the webhook pod �[1mSTEP�[0m: Wait for the deployment to be ready Mar 25 21:26:10.632: INFO: deployment "sample-webhook-deployment" doesn't have the required revision set Mar 25 21:26:12.645: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} Mar 25 21:26:14.651: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2023, time.March, 25, 21, 26, 10, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-6c69dbd86b\" is progressing."}}, CollisionCount:(*int32)(nil)} �[1mSTEP�[0m: Deploying the webhook service �[1mSTEP�[0m: Verifying the service has paired with the endpoint Mar 25 21:26:17.673: INFO: Waiting for amount of service:e2e-test-webhook endpoints to be 1 [It] should unconditionally reject operations on fail closed webhook [Conformance] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:633 �[1mSTEP�[0m: Registering a webhook that server cannot talk to, with fail closed policy, via the AdmissionRegistration API Mar 25 21:26:27.815: INFO: Waiting for webhook configuration to be ready... Mar 25 21:26:37.956: INFO: Waiting for webhook configuration to be ready... Mar 25 21:26:48.078: INFO: Waiting for webhook configuration to be ready... Mar 25 21:26:58.215: INFO: Waiting for webhook configuration to be ready... Mar 25 21:27:08.248: INFO: Waiting for webhook configuration to be ready... Mar 25 21:27:08.249: FAIL: waiting for webhook configuration to be ready Unexpected error: <*errors.errorString | 0xc000230230>: { s: "timed out waiting for the condition", } timed out waiting for the condition occurred Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.registerFailClosedWebhook(0xc000b2b8c0, {0xc003f0d2a0, 0xc}, 0x0?, 0x0?) /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:1253 +0x565 k8s.io/kubernetes/test/e2e/apimachinery.glob..func27.7() /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/apimachinery/webhook.go:237 +0x45 k8s.io/kubernetes/test/e2e.RunE2ETests(0x24efc17?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x6b7 k8s.io/kubernetes/test/e2e.TestE2E(0xc000488fd0?) _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19 testing.tRunner(0xc0006d5040, 0x72ee990) /usr/local/go/src/testing/testing.go:1446 +0x10b created by testing.(*T).Run /usr/local/go/src/testing/testing.go:1493 +0x35f [AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186 �[1mSTEP�[0m: Collecting events from namespace "webhook-7789". �[1mSTEP�[0m: Found 6 events. Mar 25 21:27:08.256: INFO: At 2023-03-25 21:26:10 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-6c69dbd86b to 1 Mar 25 21:27:08.256: INFO: At 2023-03-25 21:26:10 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-6c69dbd86b-9rkgj Mar 25 21:27:08.256: INFO: At 2023-03-25 21:26:10 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-9rkgj: {default-scheduler } Scheduled: Successfully assigned webhook-7789/sample-webhook-deployment-6c69dbd86b-9rkgj to nodes-us-central1-c-n8lj Mar 25 21:27:08.256: INFO: At 2023-03-25 21:26:12 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-9rkgj: {kubelet nodes-us-central1-c-n8lj} Pulled: Container image "k8s.gcr.io/e2e-test-images/agnhost:2.39" already present on machine Mar 25 21:27:08.256: INFO: At 2023-03-25 21:26:13 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-9rkgj: {kubelet nodes-us-central1-c-n8lj} Created: Created container sample-webhook Mar 25 21:27:08.256: INFO: At 2023-03-25 21:26:13 +0000 UTC - event for sample-webhook-deployment-6c69dbd86b-9rkgj: {kubelet nodes-us-central1-c-n8lj} Started: Started container sample-webhook Mar 25 21:27:08.265: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:27:08.265: INFO: sample-webhook-deployment-6c69dbd86b-9rkgj nodes-us-central1-c-n8lj Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:26:10 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:26:14 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:26:14 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-03-25 21:26:10 +0000 UTC }] Mar 25 21:27:08.265: INFO: Mar 25 21:27:08.285: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:27:08.294: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 29910 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:27:08.294: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:27:08.313: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:27:08.328: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:27:08.328: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:27:08.328: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:08.328: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:08.328: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:27:08.328: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:08.328: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:27:08.328: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:27:08.328: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:27:08.328: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:27:08.328: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:27:08.328: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:27:08.328: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:08.328: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:27:08.328: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:27:08.328: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.328: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:27:08.499: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:27:08.499: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:27:08.504: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 31615 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-8628":"nodes-us-central1-c-h9x3","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:17:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:19 +0000 UTC,LastTransitionTime:2023-03-25 21:12:19 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:32 +0000 UTC,LastTransitionTime:2023-03-25 21:11:47 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:26:32 +0000 UTC,LastTransitionTime:2023-03-25 21:12:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.2,},NodeAddress{Type:ExternalIP,Address:35.188.21.191,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-h9x3.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-h9x3,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:a7862b35c8b20693e5e058be0b8e2fe9,SystemUUID:a7862b35-c8b2-0693-e5e0-58be0b8e2fe9,BootID:e97ef4b7-654d-405d-809c-81b210961826,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-8628^af7004a2-cb53-11ed-8b59-5aab6402b44e kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-83ff8a3f-c289-4c71-802d-246ac8c7356f kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-9220d80a-06c3-4156-ba01-584d48710fc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-8628^af7004a2-cb53-11ed-8b59-5aab6402b44e,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-9220d80a-06c3-4156-ba01-584d48710fc4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-83ff8a3f-c289-4c71-802d-246ac8c7356f,DevicePath:,},},Config:nil,},} Mar 25 21:27:08.505: INFO: Logging kubelet events for node nodes-us-central1-c-h9x3 Mar 25 21:27:08.518: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-h9x3 Mar 25 21:27:08.606: INFO: kube-proxy-nodes-us-central1-c-h9x3 started at 2023-03-25 21:11:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:27:08.606: INFO: calico-node-kbqpg started at 2023-03-25 21:11:48 +0000 UTC (4+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:27:08.606: INFO: update-demo-nautilus-tbrmw started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:27:08.606: INFO: pod-073166d2-aca0-46c3-9a8f-e2482b1daa08 started at 2023-03-25 21:26:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:27:08.606: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:26:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:27:08.606: INFO: csi-gce-pd-node-qxlml started at 2023-03-25 21:11:48 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:08.606: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:08.606: INFO: csi-hostpathplugin-0 started at 2023-03-25 21:26:04 +0000 UTC (0+7 container statuses recorded) Mar 25 21:27:08.606: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container hostpath ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container liveness-probe ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container node-driver-registrar ready: true, restart count 0 Mar 25 21:27:08.606: INFO: csi-mockplugin-0 started at 2023-03-25 21:26:57 +0000 UTC (0+3 container statuses recorded) Mar 25 21:27:08.606: INFO: Container csi-provisioner ready: false, restart count 0 Mar 25 21:27:08.606: INFO: Container driver-registrar ready: false, restart count 0 Mar 25 21:27:08.606: INFO: Container mock ready: false, restart count 0 Mar 25 21:27:08.606: INFO: ss-0 started at 2023-03-25 21:27:06 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container webserver ready: false, restart count 0 Mar 25 21:27:08.606: INFO: ss2-2 started at 2023-03-25 21:27:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container webserver ready: false, restart count 0 Mar 25 21:27:08.606: INFO: ss-0 started at 2023-03-25 21:25:28 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:08.606: INFO: metadata-proxy-v0.12-5p8h2 started at 2023-03-25 21:11:49 +0000 UTC (1+2 container statuses recorded) Mar 25 21:27:08.606: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:27:08.606: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:27:08.606: INFO: hostexec-nodes-us-central1-c-h9x3-nn2hw started at 2023-03-25 21:26:39 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:27:08.606: INFO: suspend-false-to-true-bcx87 started at 2023-03-25 21:26:24 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:08.606: INFO: Container c ready: true, restart count 0 Mar 25 21:27:09.921: INFO: Latency metrics for node nodes-us-central1-c-h9x3 Mar 25 21:27:09.921: INFO: Logging node info for node nodes-us-central1-c-lhrm Mar 25 21:27:09.930: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-lhrm 76a50663-719c-42bf-9be7-279e0e21a792 32419 0 2023-03-25 21:11:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-lhrm kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-lhrm topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2870":"csi-mock-csi-mock-volumes-2870","csi-mock-csi-mock-volumes-3360":"csi-mock-csi-mock-volumes-3360","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-lhrm"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.5/32 projectcalico.org/IPv4IPIPTunnelAddr:100.116.67.192 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:34 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:26:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-lhrm,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111192064 0} {<nil>} 4014836Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006334464 0} {<nil>} 3912436Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:05 +0000 UTC,LastTransitionTime:2023-03-25 21:12:05 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:43 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:43 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:43 +0000 UTC,LastTransitionTime:2023-03-25 21:11:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:26:43 +0000 UTC,LastTransitionTime:2023-03-25 21:11:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.5,},NodeAddress{Type:ExternalIP,Address:35.239.17.51,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-lhrm.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-lhrm,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:d810770c90b6d7afa58add28465ec18e,SystemUUID:d810770c-90b6-d7af-a58a-dd28465ec18e,BootID:6ee5055f-eb26-483e-b777-4e617fd05b2c,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:39e1e963e5310e9c313bad51523be012ede7b35bb9316517d19089a010356592 k8s.gcr.io/e2e-test-images/busybox:1.29-1],SizeBytes:732746,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:27:09.931: INFO: Logging kubelet events for node nodes-us-central1-c-lhrm Mar 25 21:27:09.955: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-lhrm Mar 25 21:27:10.004: INFO: coredns-5d479c4f64-kt8zf started at 2023-03-25 21:12:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container coredns ready: true, restart count 0 Mar 25 21:27:10.005: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:26:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:27:10.005: INFO: deployment-shared-map-item-removal-7c658794b9-bczsz started at 2023-03-25 21:25:39 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container nginx ready: false, restart count 0 Mar 25 21:27:10.005: INFO: hostexec-nodes-us-central1-c-lhrm-q6mvb started at 2023-03-25 21:26:58 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:27:10.005: INFO: local-client started at 2023-03-25 21:27:08 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container local-client ready: false, restart count 0 Mar 25 21:27:10.005: INFO: csi-gce-pd-node-sd4tl started at 2023-03-25 21:11:34 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:10.005: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:10.005: INFO: csi-mockplugin-0 started at 2023-03-25 21:25:54 +0000 UTC (0+4 container statuses recorded) Mar 25 21:27:10.005: INFO: Container busybox ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container csi-provisioner ready: false, restart count 1 Mar 25 21:27:10.005: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container mock ready: true, restart count 0 Mar 25 21:27:10.005: INFO: csi-mockplugin-0 started at 2023-03-25 21:26:10 +0000 UTC (0+4 container statuses recorded) Mar 25 21:27:10.005: INFO: Container busybox ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container csi-provisioner ready: true, restart count 2 Mar 25 21:27:10.005: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container mock ready: true, restart count 0 Mar 25 21:27:10.005: INFO: hostexec-nodes-us-central1-c-lhrm-jspp9 started at 2023-03-25 21:26:42 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:27:10.005: INFO: csi-mockplugin-attacher-0 started at 2023-03-25 21:26:52 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:27:10.005: INFO: pvc-volume-tester-x4g4s started at 2023-03-25 21:27:07 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container volume-tester ready: true, restart count 0 Mar 25 21:27:10.005: INFO: calico-node-vmf4q started at 2023-03-25 21:11:34 +0000 UTC (4+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:27:10.005: INFO: dns-test-9e62d3f5-8734-4efa-82aa-bac10651467e started at 2023-03-25 21:15:41 +0000 UTC (0+3 container statuses recorded) Mar 25 21:27:10.005: INFO: Container jessie-querier ready: false, restart count 6 Mar 25 21:27:10.005: INFO: Container querier ready: false, restart count 6 Mar 25 21:27:10.005: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:10.005: INFO: kube-proxy-nodes-us-central1-c-lhrm started at 2023-03-25 21:11:33 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:27:10.005: INFO: metadata-proxy-v0.12-bshtk started at 2023-03-25 21:11:34 +0000 UTC (1+2 container statuses recorded) Mar 25 21:27:10.005: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:27:10.005: INFO: dns-test-105cc4fa-26dc-4534-a134-55e045d90aca started at 2023-03-25 21:17:53 +0000 UTC (0+3 container statuses recorded) Mar 25 21:27:10.005: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container querier ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:10.005: INFO: csi-mockplugin-0 started at 2023-03-25 21:26:52 +0000 UTC (0+3 container statuses recorded) Mar 25 21:27:10.005: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container mock ready: true, restart count 0 Mar 25 21:27:10.005: INFO: csi-mockplugin-0 started at 2023-03-25 21:26:58 +0000 UTC (0+3 container statuses recorded) Mar 25 21:27:10.005: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container driver-registrar ready: true, restart count 0 Mar 25 21:27:10.005: INFO: Container mock ready: true, restart count 0 Mar 25 21:27:10.005: INFO: pod-1f990a97-e266-440f-920c-62307a8ca2c7 started at 2023-03-25 21:27:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.005: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:27:10.180: INFO: Latency metrics for node nodes-us-central1-c-lhrm Mar 25 21:27:10.180: INFO: Logging node info for node nodes-us-central1-c-n8lj Mar 25 21:27:10.188: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-n8lj dd8c3b63-39dd-46de-9084-32437333d963 32520 0 2023-03-25 21:11:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-n8lj kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-n8lj topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-n8lj"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.6/32 projectcalico.org/IPv4IPIPTunnelAddr:100.100.149.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kops-controller Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {Go-http-client Update v1 2023-03-25 21:12:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:26:22 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-n8lj,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:09 +0000 UTC,LastTransitionTime:2023-03-25 21:12:09 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:04 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:04 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:04 +0000 UTC,LastTransitionTime:2023-03-25 21:11:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:27:04 +0000 UTC,LastTransitionTime:2023-03-25 21:11:57 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.6,},NodeAddress{Type:ExternalIP,Address:104.154.247.46,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-n8lj.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-n8lj,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:2709b3a573fbee23f65e26d286a5f2ab,SystemUUID:2709b3a5-73fb-ee23-f65e-26d286a5f2ab,BootID:e44ca399-bbc4-49ff-b51a-d15c417c2bd4,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/jessie-dnsutils@sha256:11e6a66017ba4e4b938c1612b7a54a3befcefd354796c04e1dba76873a13518e k8s.gcr.io/e2e-test-images/jessie-dnsutils:1.5],SizeBytes:112030526,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf k8s.gcr.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonroot@sha256:b9e2958a3dd879e3cf11142228c6d073d0fc4ea2e857c3be6f4fb0ab5fb2c937 k8s.gcr.io/e2e-test-images/nonroot:1.2],SizeBytes:17748301,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac k8s.gcr.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-3ee43c51-cad0-46e4-9d89-3b69174c8715],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-3ee43c51-cad0-46e4-9d89-3b69174c8715,DevicePath:,},},Config:nil,},} Mar 25 21:27:10.189: INFO: Logging kubelet events for node nodes-us-central1-c-n8lj Mar 25 21:27:10.203: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-n8lj Mar 25 21:27:10.215: INFO: liveness-8a3334e9-8ed9-4389-8512-aa18efce6b01 started at 2023-03-25 21:25:53 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.215: INFO: Container agnhost-container ready: true, restart count 3 Mar 25 21:27:10.215: INFO: dns-test-3cf96a7e-8f02-4424-82e8-042229d13c52 started at 2023-03-25 21:17:22 +0000 UTC (0+3 container statuses recorded) Mar 25 21:27:10.215: INFO: Container jessie-querier ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Container querier ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:10.216: INFO: ss-1 started at 2023-03-25 21:26:13 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:10.216: INFO: calico-node-csrdb started at 2023-03-25 21:11:38 +0000 UTC (4+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:27:10.216: INFO: kube-proxy-nodes-us-central1-c-n8lj started at 2023-03-25 21:11:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:27:10.216: INFO: deployment-shared-map-item-removal-7c658794b9-p7rl8 started at 2023-03-25 21:25:39 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Container nginx ready: false, restart count 0 Mar 25 21:27:10.216: INFO: update-demo-nautilus-wxf8x started at 2023-03-25 21:26:40 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Container update-demo ready: true, restart count 0 Mar 25 21:27:10.216: INFO: ss2-1 started at 2023-03-25 21:27:02 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:10.216: INFO: liveness-091ad6fe-b2c2-4b6b-876c-42be67f6167e started at 2023-03-25 21:25:47 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Container agnhost-container ready: true, restart count 0 Mar 25 21:27:10.216: INFO: metadata-proxy-v0.12-bx68m started at 2023-03-25 21:11:38 +0000 UTC (1+2 container statuses recorded) Mar 25 21:27:10.216: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:27:10.216: INFO: csi-gce-pd-node-l2wq2 started at 2023-03-25 21:11:38 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:10.216: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:27:10.216: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:10.216: INFO: sample-webhook-deployment-6c69dbd86b-9rkgj started at 2023-03-25 21:26:10 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.216: INFO: Container sample-webhook ready: true, restart count 0 Mar 25 21:27:10.385: INFO: Latency metrics for node nodes-us-central1-c-n8lj Mar 25 21:27:10.385: INFO: Logging node info for node nodes-us-central1-c-wcck Mar 25 21:27:10.397: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-wcck 644e771e-413f-4cfd-b11f-eeeb058c0bae 32586 0 2023-03-25 21:11:30 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-wcck kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-wcck topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-wcck"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.3/32 projectcalico.org/IPv4IPIPTunnelAddr:100.101.135.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:31 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kubelet Update v1 2023-03-25 21:26:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-03-25 21:26:46 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-wcck,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4006326272 0} {<nil>} 3912428Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:12:03 +0000 UTC,LastTransitionTime:2023-03-25 21:12:03 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:27:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:30 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:27:03 +0000 UTC,LastTransitionTime:2023-03-25 21:11:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.3,},NodeAddress{Type:ExternalIP,Address:34.132.179.99,},NodeAddress{Type:InternalDNS,Address:nodes-us-central1-c-wcck.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:nodes-us-central1-c-wcck,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:e60408a7f079ad0a10647ff09342a206,SystemUUID:e60408a7-f079-ad0a-1064-7ff09342a206,BootID:9439752c-ffd5-416c-8040-2494d3627739,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[k8s.gcr.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c k8s.gcr.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/agnhost@sha256:7e8bdd271312fd25fc5ff5a8f04727be84044eb3d7d8d03611972a6752e2e11e k8s.gcr.io/e2e-test-images/agnhost:2.39],SizeBytes:51105200,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:20f25f275d46aa728f7615a1ccc19c78b2ed89435bf943a44b339f70f45508e6 k8s.gcr.io/e2e-test-images/httpd:2.4.39-2],SizeBytes:41902010,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/httpd@sha256:1b9d1b2f36cb2dbee1960e82a9344aeb11bd4c4c03abf5e1853e0559c23855e3 k8s.gcr.io/e2e-test-images/httpd:2.4.38-2],SizeBytes:40764680,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/sample-apiserver@sha256:f9c93b92b6ff750b41a93c4e4fe0bfe384597aeb841e2539d5444815c55b2d8f k8s.gcr.io/e2e-test-images/sample-apiserver:1.17.5],SizeBytes:24316368,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:4e74c0492bceddc598de1c90cc5bc14dcda94cb49fa9c5bad9d117c4834b5e08 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.1],SizeBytes:22631062,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-provisioner@sha256:c8e03f60afa90a28e4bb6ec9a8d0fc36d89de4b7475cf2d613afa793ec969fe0 k8s.gcr.io/sig-storage/csi-provisioner:v2.2.0],SizeBytes:22629806,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:36c31f7e1f433c9634d24f876353e8646246d81a03c4e351202c2644daff1620 k8s.gcr.io/sig-storage/csi-resizer:v1.2.0],SizeBytes:21584611,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:c5be65d6679efabb969d9b019300d187437ae876f992c40911fd2892bbef3b36 k8s.gcr.io/sig-storage/csi-attacher:v3.2.0],SizeBytes:21367429,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-attacher@sha256:60ab9b3e6a030d3038c87c0d6bca2930f58d1d72823e6a4af09767dc83b696a2 k8s.gcr.io/sig-storage/csi-attacher:v3.2.1],SizeBytes:21366448,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-snapshotter@sha256:ed98431376c9e944e19a465fe8ea944806714dd95416a0821096c78d66b579bd k8s.gcr.io/sig-storage/csi-snapshotter:v4.1.1],SizeBytes:21331336,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a k8s.gcr.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[gcr.io/k8s-authenticated-test/agnhost@sha256:4057a5580c7b59c4fe10d8ab2732c9dec35eea80fd41f7bafc7bd5acc7edf727 gcr.io/k8s-authenticated-test/agnhost:2.6],SizeBytes:18352698,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[k8s.gcr.io/sig-storage/hostpathplugin@sha256:232fe80174d60d520d36043103853a1d7ab4b7f3782cf43e45034f04ccda58ce k8s.gcr.io/sig-storage/hostpathplugin:v1.7.1],SizeBytes:14930811,},ContainerImage{Names:[registry.k8s.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e registry.k8s.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:2dee3fe5fe861bb66c3a4ac51114f3447a4cd35870e0f2e2b558c7a400d89589 k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.2.0],SizeBytes:8561694,},ContainerImage{Names:[k8s.gcr.io/sig-storage/mock-driver@sha256:a7b517f9e0f42ffade802eef9cefa271372386b85f55b702b493241e58459793 k8s.gcr.io/sig-storage/mock-driver:v4.1.0],SizeBytes:8223849,},ContainerImage{Names:[k8s.gcr.io/sig-storage/livenessprobe@sha256:529be2c9770add0cdd0c989115222ea9fc1be430c11095eb9f6dafcf98a36e2b k8s.gcr.io/sig-storage/livenessprobe:v2.4.0],SizeBytes:7960518,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/nginx@sha256:13616070e3f29de4417eee434a8ef472221c9e51b3d037b5a6b46cef08eb7443 k8s.gcr.io/e2e-test-images/nginx:1.14-2],SizeBytes:6979041,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/k8s-custom-iptables@sha256:8b1a0831e88973e2937eae3458edb470f20d54bf80d88b6a3355f36266e16ca5 registry.k8s.io/k8s-custom-iptables:1.0],SizeBytes:3335579,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[k8s.gcr.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf k8s.gcr.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db k8s.gcr.io/pause:3.6 registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-95ba5319-0d81-47ff-a183-342a70f8c684 kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/pvc-77d026dd-dc17-4b6e-a71d-7c5fc4a1324c kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-ad609723-3805-4e43-992e-74f8608460b3],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/disks/pvc-ad609723-3805-4e43-992e-74f8608460b3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/pd.csi.storage.gke.io^projects/UNSPECIFIED/zones/UNSPECIFIED/disks/e2e-95ba5319-0d81-47ff-a183-342a70f8c684,DevicePath:,},},Config:nil,},} Mar 25 21:27:10.398: INFO: Logging kubelet events for node nodes-us-central1-c-wcck Mar 25 21:27:10.414: INFO: Logging pods the kubelet thinks is on node nodes-us-central1-c-wcck Mar 25 21:27:10.426: INFO: kube-proxy-nodes-us-central1-c-wcck started at 2023-03-25 21:11:31 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:27:10.426: INFO: deployment-shared-map-item-removal-7c658794b9-pndcp started at 2023-03-25 21:25:39 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container nginx ready: false, restart count 0 Mar 25 21:27:10.426: INFO: coredns-autoscaler-557ccb4c66-8ggn8 started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container autoscaler ready: true, restart count 0 Mar 25 21:27:10.426: INFO: coredns-5d479c4f64-fg99b started at 2023-03-25 21:12:03 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container coredns ready: true, restart count 0 Mar 25 21:27:10.426: INFO: hostexec-nodes-us-central1-c-wcck-4bsj6 started at <nil> (0+0 container statuses recorded) Mar 25 21:27:10.426: INFO: calico-node-wrw6h started at 2023-03-25 21:11:31 +0000 UTC (4+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:27:10.426: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:27:10.426: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:27:10.426: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:27:10.426: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:27:10.426: INFO: gcepd-client started at <nil> (0+0 container statuses recorded) Mar 25 21:27:10.426: INFO: csi-gce-pd-node-j65hz started at 2023-03-25 21:11:31 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:10.426: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:27:10.426: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:10.426: INFO: exec-volume-test-inlinevolume-5fd8 started at 2023-03-25 21:26:57 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container exec-container-inlinevolume-5fd8 ready: false, restart count 0 Mar 25 21:27:10.426: INFO: ss2-0 started at 2023-03-25 21:26:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:10.426: INFO: gcepd-client started at 2023-03-25 21:27:04 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container gcepd-client ready: false, restart count 0 Mar 25 21:27:10.426: INFO: pod-bc7a3e30-95a3-4ea9-baaa-062730f59235 started at 2023-03-25 21:27:02 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container write-pod ready: false, restart count 0 Mar 25 21:27:10.426: INFO: ss-2 started at 2023-03-25 21:26:37 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.426: INFO: Container webserver ready: true, restart count 0 Mar 25 21:27:10.426: INFO: metadata-proxy-v0.12-2bl8f started at 2023-03-25 21:11:31 +0000 UTC (1+2 container statuses recorded) Mar 25 21:27:10.426: INFO: Init container update-ipdtables ready: true, restart count 0 Mar 25 21:27:10.426: INFO: Container metadata-proxy ready: true, restart count 0 Mar 25 21:27:10.426: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Mar 25 21:27:10.557: INFO: Latency metrics for node nodes-us-central1-c-wcck �[1mSTEP�[0m: Collecting events from namespace "webhook-7789-markers". �[1mSTEP�[0m: Found 0 events. Mar 25 21:27:10.577: INFO: POD NODE PHASE GRACE CONDITIONS Mar 25 21:27:10.577: INFO: Mar 25 21:27:10.584: INFO: Logging node info for node control-plane-us-central1-c-mjmx Mar 25 21:27:10.591: INFO: Node Info: &Node{ObjectMeta:{control-plane-us-central1-c-mjmx 9118fd7a-0b81-4aa7-99a7-4cc76b7ba925 29910 0 2023-03-25 21:08:20 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-standard-2 beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:control-plane-us-central1-c-mjmx kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/control-plane: node-role.kubernetes.io/node: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:e2-standard-2 topology.gke.io/zone:us-central1-c topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/control-plane-us-central1-c-mjmx"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.4/32 projectcalico.org/IPv4IPIPTunnelAddr:100.106.171.128 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-03-25 21:08:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {protokube Update v1 2023-03-25 21:08:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-03-25 21:09:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kops-controller Update v1 2023-03-25 21:10:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-03-25 21:10:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {Go-http-client Update v1 2023-03-25 21:10:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/control-plane-us-central1-c-mjmx,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8332763136 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{8227905536 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-03-25 21:10:29 +0000 UTC,LastTransitionTime:2023-03-25 21:10:29 +0000 UTC,Reason:CalicoIsUp,Message:Calico is running on this node,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:08:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-03-25 21:26:03 +0000 UTC,LastTransitionTime:2023-03-25 21:10:23 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.0.16.4,},NodeAddress{Type:ExternalIP,Address:35.202.141.30,},NodeAddress{Type:InternalDNS,Address:control-plane-us-central1-c-mjmx.c.k8s-gce-cvm-1-5-1-6-ctl-skew.internal,},NodeAddress{Type:Hostname,Address:control-plane-us-central1-c-mjmx,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ab308d7b01b8d3dc4b2ec5f527771934,SystemUUID:ab308d7b-01b8-d3dc-4b2e-c5f527771934,BootID:b8891798-b1f4-469c-bc42-326f7fb05c98,KernelVersion:5.15.0-1030-gcp,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.18,KubeletVersion:v1.23.17,KubeProxyVersion:v1.23.17,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-apiserver-amd64:v1.23.17 registry.k8s.io/kube-apiserver-amd64:v1.23.17],SizeBytes:131353043,},ContainerImage{Names:[k8s.gcr.io/kube-controller-manager-amd64:v1.23.17 registry.k8s.io/kube-controller-manager-amd64:v1.23.17],SizeBytes:121289017,},ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.23.17 registry.k8s.io/kube-proxy-amd64:v1.23.17],SizeBytes:112752183,},ContainerImage{Names:[docker.io/calico/cni@sha256:7ca5c455cff6c0d661e33918d95a1133afb450411dbfb7e4369a9ecf5e0212dc docker.io/calico/cni:v3.23.5],SizeBytes:107998578,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[docker.io/calico/node@sha256:b7f4f7a0ce463de5d294fdf2bb13f61035ec6e3e5ee05dd61dcc8e79bc29d934 docker.io/calico/node:v3.23.5],SizeBytes:75105675,},ContainerImage{Names:[registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver@sha256:b316059d0057e2bcb98d680feb99cd16e031260dd4ad0ce6c51ba8a28b48d9b7 registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver:v1.3.4],SizeBytes:69998657,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager-slim@sha256:8727adc059334e0e3329dbccce116a734da4a090da5e86c8cddccaf333caa666 registry.k8s.io/etcdadm/etcd-manager-slim:v3.0.20230201],SizeBytes:63926165,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[docker.io/calico/kube-controllers@sha256:58cc91c551e9e941a752e205eefed1c8da56f97a51e054b3d341b67bb7bf27eb docker.io/calico/kube-controllers:v3.23.5],SizeBytes:53774679,},ContainerImage{Names:[k8s.gcr.io/kube-scheduler-amd64:v1.23.17 registry.k8s.io/kube-scheduler-amd64:v1.23.17],SizeBytes:53197112,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:45219545,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:43628585,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:20c828075d1e36f679d6a91e905b0927141eef5e15be0c9a1ca4a6a0ed9313d2 registry.k8s.io/sig-storage/csi-provisioner:v2.1.0],SizeBytes:21205045,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:50c3cfd458fc8e0bf3c8c521eac39172009382fc66dc5044a330d137c6ed0b09 registry.k8s.io/sig-storage/csi-attacher:v3.1.0],SizeBytes:20103959,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:7a5ba58a44e0d749e0767e4e37315bcf6a61f33ce3185c1991848af4db0fb70a registry.k8s.io/sig-storage/csi-resizer:v1.1.0],SizeBytes:20096832,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:9af9bf28430b00a0cedeb2ec29acadce45e6afcecd8bdf31c793c624cfa75fa7 registry.k8s.io/sig-storage/csi-snapshotter:v3.0.3],SizeBytes:19500777,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.1.0],SizeBytes:9068367,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:5074298,},ContainerImage{Names:[docker.io/library/busybox@sha256:b5d6fe0712636ceb7430189de28819e195e8966372edfc2d9409d79402a0dc16 docker.io/library/busybox:latest],SizeBytes:2596524,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Mar 25 21:27:10.592: INFO: Logging kubelet events for node control-plane-us-central1-c-mjmx Mar 25 21:27:10.609: INFO: Logging pods the kubelet thinks is on node control-plane-us-central1-c-mjmx Mar 25 21:27:10.636: INFO: etcd-manager-events-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:27:10.636: INFO: csi-gce-pd-node-cjtjm started at 2023-03-25 21:09:59 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:10.636: INFO: Container csi-driver-registrar ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:10.636: INFO: csi-gce-pd-controller-69f6bf6d89-jrn46 started at 2023-03-25 21:09:59 +0000 UTC (0+5 container statuses recorded) Mar 25 21:27:10.636: INFO: Container csi-attacher ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container csi-provisioner ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container csi-resizer ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container csi-snapshotter ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container gce-pd-driver ready: true, restart count 0 Mar 25 21:27:10.636: INFO: kops-controller-68kjt started at 2023-03-25 21:09:59 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Container kops-controller ready: true, restart count 0 Mar 25 21:27:10.636: INFO: calico-kube-controllers-795c657547-c8n5n started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Container calico-kube-controllers ready: true, restart count 0 Mar 25 21:27:10.636: INFO: dns-controller-6f69f47785-tw2gq started at 2023-03-25 21:10:29 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Container dns-controller ready: true, restart count 0 Mar 25 21:27:10.636: INFO: etcd-manager-main-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (11+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container init-etcd-3-5-7 ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container etcd-manager ready: true, restart count 0 Mar 25 21:27:10.636: INFO: kube-apiserver-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+2 container statuses recorded) Mar 25 21:27:10.636: INFO: Container healthcheck ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container kube-apiserver ready: true, restart count 3 Mar 25 21:27:10.636: INFO: kube-controller-manager-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Container kube-controller-manager ready: true, restart count 5 Mar 25 21:27:10.636: INFO: kube-proxy-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Container kube-proxy ready: true, restart count 0 Mar 25 21:27:10.636: INFO: kube-scheduler-control-plane-us-central1-c-mjmx started at 2023-03-25 21:06:12 +0000 UTC (0+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Container kube-scheduler ready: true, restart count 0 Mar 25 21:27:10.636: INFO: calico-node-s7xww started at 2023-03-25 21:09:59 +0000 UTC (4+1 container statuses recorded) Mar 25 21:27:10.636: INFO: Init container upgrade-ipam ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container install-cni ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container mount-bpffs ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Init container flexvol-driver ready: true, restart count 0 Mar 25 21:27:10.636: INFO: Container calico-node ready: true, restart count 0 Mar 25 21:27:10.815: INFO: Latency metrics for node control-plane-us-central1-c-mjmx Mar 25 21:27:10.815: INFO: Logging node info for node nodes-us-central1-c-h9x3 Mar 25 21:27:10.819: INFO: Node Info: &Node{ObjectMeta:{nodes-us-central1-c-h9x3 1cb92ff9-c31f-44ae-a86e-b8e6f3397956 31615 0 2023-03-25 21:11:47 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-central1 failure-domain.beta.kubernetes.io/zone:us-central1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:nodes-us-central1-c-h9x3 kubernetes.io/os:linux kubernetes.io/role:node node-role.kubernetes.io/node: node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-central1-c topology.hostpath.csi/node:nodes-us-central1-c-h9x3 topology.kubernetes.io/region:us-central1 topology.kubernetes.io/zone:us-central1-c] map[csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-8628":"nodes-us-central1-c-h9x3","pd.csi.storage.gke.io":"projects/k8s-gce-cvm-1-5-1-6-ctl-skew/zones/us-central1-c/instances/nodes-us-central1-c-h9x3"} node.alpha.kubernetes.io/ttl:0 projectcalico.org/IPv4Address:10.0.16.2/32 projectcalico.org/IPv4IPIPTunnelAddr:100.125.212.64 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-03-25 21:11:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kops-controller Update v1 2023-03-25 21:11:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:cloud.google.com/metadata-proxy-ready":{},"f:kubernetes.io/role":{},"f:node-role.kubernetes.io/node":{}}}} } {Go-http-client Update v1 2023-03-25 21:12:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:projectcalico.org/IPv4Address":{},"f:projectcalico.org/IPv4IPIPTunnelAddr":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-03-25 21:17:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-03-25 21:17:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.gke.io/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-gce-cvm-1-5-1-6-ctl-skew/us-central1-c/nodes-us-central1-c-h9x3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4111183872 0} {<nil>} 4014828Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 4